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ABSTRACT 

The purpose was to determine the effectiveness of a 
inservice program designed to help elementary school teachers 
implement an activity approach to learning mathematics in their 
classroom using Developing Mathematical Processes (DMP) , Thirty^eig 
kindergarten and first grade teachers participated. The success of 
the inservice program was judged by comparing the teachers* 
performance on 24 objectives with performance criteria based on the 
results of an assessment of the behaviors of successful experienced 
DMP teachers. Results showed that the teachers exceeded the criteria 
levels on 13 of the objectives; it was found also that teacher 
performance did not seem to be related to teacher charaGteristics 
such as age^ experience^ or professional activities. Behaviors for 
which teachers did not reach criterion levels included asking probii 
questions^ describing the mathematical processes emphasized by DMP^ 
and managing instruction to provide for individual differences, 
Seventy-- six percent of the teachers were judged to have done an 
adequate job of implementing an activity approach, (Author/DT) 
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STATEMENT OF FOCUS 



Individually Guided Education (IGE) is a new cnmprehensive system 
of elementary educ-ation. The following componentB of the IGE system" 
are m varying atagas of development and Iraplementationi a new 
organization for instruction and related administrative arrangements; 
a model of instructional prograinJnR for the Individual student; and 
curriculum componenta in pr«readJng, reading, mathematics, motivation 
and environmental education. Tlie development of other curriculum 
components, of a system for raanailng instruction by computer, and of 
instructional strateglea is needed to complete the system. Continuing 
programmatic research Is required to provide a sound knowledge base fSr 
the components under development and for improved second generation 
components. Finally, systematic implementation Is easential so that 
the products will function properly in the IGE schools. 

The Center plans and carries out the research, development, and 
Implementation components of its IGE program in this sequencer 
a) identify the needs and delimit the component problem area; 
U) assess the possible constraints-^^f inancial resources and availability 
ot staff; (3) formulate general plans and specific procedures for 
solving the problems; (4) secure and allocate human and material 
resources to carry out the plans; (5) provide for effectiva communication 
among personnel and efficient managemeni of activities and resources; 
and (6) evaluate the effectiveness of each activity and its contri- 
bution to Che total program and correct any difficulties through 
feedback mechanisins and appropriate management techniques. 

A self-renewing Bystem of elementary education is projected In 
each participating elementary school, i.e., one which is less dependent 
n? direction and is more responsive to the needs 

Of the children attending tach particular school. In the IGE schools. 
Center-developed and other curriculum products compatible with the 
Center s instructional programing model will lead to higher morale 
and job satisfaction among educational p«rsonnel. Each developmental 
product makes its unique contribution to IGE as it is implemented in 

various research components add to the knowledge of 
Center practitioners, developers, and theorists. 
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ABSTMCT 



The purpDse of this study was to determina the e£f eetlvaneii 
of an inservlca program designed to help elementary school teaeheri 
Implement an activity approach to learning mathematics in their 
claesrooms. Characteristlce of an activity approach include an em- 
phasis on real^world pfoblems^ use of manipulative materials^ and 
having children work in imall groups ^ while the teacher li a reiource 
personp not a lecturer , who aiki students to validate their state- ^ 
ments and Who asseBees children's achievement in order to provide for 
individual differences. Teachers need special materials If they are 
to Implement an activity approach; in this study the teachera were 
provided with Devaloping Itethematical Processes (DMP) 5 a niew elamen^ 
tary mathematics program developed by the Wlaconsln Research and 
Development Center for Cognitive Laarnlng, 

The iniervice program was designed to help teachers achlevg 24 
behavlDral objeatives or cpmpetencles related to Implementing an ac- 
tivity approach. These behaviors dealt with the use of instructional 
and assessment materials ^ the verbal behavior of the teaeheri the 
organization of the classroom^ the teacher's knowledge of mathematics , 

Kill 



and managing instruction in order to provide for Individual differ^ 
encee. The Inservice program was conducted in two parte~a two-day 
workshop before school started , and a series of four one-hour in- 
sarvlce meetings during the first two months of the school yaar. 
The tvaluation of the inservice program began at the conclusion of 
the inservice ineetlngSs and continued through the first semester* 

The evaluation procedures included classroom observations, ques^ 
tlonnaireSj and interviews. Appropriate Instruments of each type 
were developed to measure teacher performance and other character^ 
is tics such as age, eKparlence, and profeialonal actlvltlei- 

There were 38 kindergarten and first-grade teachere who parti- 
cipated in the study | these teachers came from four inner-city and 
four multiunit schools that were also participating in the small- 
scale field test of Dtff, 

The success of the inservice program was judged by comparing 
the teachers' performance on the objectives with performance criteria; 
these criteria were based on the results of an assessment of the be-^ 
havlors of experienced DMP teachers who were believed to be success^ 
ful in implementing an activity approach. The teachers in the study 
exceeded the criterion levels on 13 of the 24 objeetivei, and multi- 
unit teachers reached the criterion levels on three additional ob" 
jeetiveai teacher performance did not seem to be related to teacher 
characteristics such as age, experience | or professional activities. 
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The behaviors for which teachers did not reach the criterion levels 
Included asking probing questions, describing the mathematical pro- 
ceases emphasised by Dlffj and managing Instruction to provide for 
individual differences* However, 76% of the teaehars were Judged to 
have done an adequate Job of implementing an activity approach, and 
the insefvice program appeared to be an effective means of Iniproving 
teacher performance* The continuing serlee of inservlce meetings 
was particularly effective in encouraging teachers to change their 
teaching practices* ' 
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Chapter 1 
INTRODUCTION 

During the past fifteen yearip substantial changes have taken 
place In the elementary mathematics currlculuin; these changes have 
been accompanied by many recommendations for improving the teaching 
of mathematics i Teachers have been asked "to present mathematics as 
the pursuit of the truth by a process of Inquiry" (Cambridge Con^ 
ference on School Mathamatics, 1963, p* 26), and "to regard mathe-^ 
matlce as a creatlva actlvity™something which one does rather than 
eomething which one learni" (Coninittee on the Undergraduate ProgrOTi 
in Mathematics j 1971s P* 20) p In addition to the conaerns o£ matha^ 
maticlanij research in developmental psychology Indicates that mathe*- 
matlcs teaching in the elementary school should provide children with 
an informal classroom atmosphere^ including opportunities for using 
physical materials, for group interaction, and for learning indepen- 
dent of the teacher (Lovell, 1972). While these statements are vague 
about what a teacher should actually do, they imply that a mathe- 
matics classroom should be a place of Inquiry and activity, where 
children learn mathematics actively rather than abiorblng it pas- 
sively* Many different terms have been used to describe this kind 
of mathematics teaching ; in this study it will be referred to as an 
"activity approach to learning mathematics* " 
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The study reported in this paper investigates the effectiveness 
of an inservice training program designed to help elamentary school 
teachers implement an activity approach to learning mathematiGs. 
The Importance of inservice training in implementing new approaches 
to matheTnatlcs has long been recognized. For examples the report 
of the Cambridge Conference on Teacher Training (1967) emphasises 
that the greatest difficulty in implementing the goals of the 1963 
Gambrldge Conference lies in the problem of teacher training. And 
ai Heathers (1967) pDlnts outp teacher education programs have gen» 
erally not prepared teachers so that they can Implement new Ideas 
in education like an activity approach to learning mathematics* 
Further auppQrt for Heathers' conments comes from a study by Goodladp 
Kleins and Associates (1970) that shows how attempts to implement 
new ideas in elementary schools have resulted in almost no change 
at' all, except perhaps in the terminology used by teachers. In 
mathematiea classrooms , for eKample, teachers often used "new math" 
programs^ but the "old pedagogy" still prevailed. If teachers are 
to implement an activity approach successfully in their clasiroomSy 
then an effective Inservice program— an inservice program that changes 
teacher performance— is c3 early required* 

While there has been a substantial amount of Inservice training 
provided for teachers of mathematics during recent years ^ there is 
little evidence as to what kind of an inservice ppogram might be 
effective in helping teachers implement an activity approach to 



learning matheinatlcs. The study being reported here provides some 
of that evidence- In order to describe the study in more detail, 
it is first necessary to define more precisely what constitutes an ' 
activity approach to learning mathematics* The remainder of this 
chapter will include an overview of the inservlce program and Its 
objectives, followed by a stateiiient of the specific questiona that 
the study was designed to answer* 
An Activity Approach to Learning Math^TOatlcs 

An activity approach to learning matheniatice has a number of 
Important characteristics. First, cuch an approach emphasizes lolv- 
Ing pirobiems that are real to the child. Following the goals for 
mathematics instruction stated by Buck (1965)^ the teacher Is ex= 
peeted to stress the relationship of mathematics to real-=world prob= 
lama. Measurement problems are an example of one way a teacher can 
use common situations to generate a substantial anrount of elementary 
mathematics (Romberg, Fletcher^ & Scott , 1968)* This emphasis on 
problCTi solving links the activity approach with heuristic teachings 
a concept based mostly on the writings of Pelya* the relationship of 
heuristics to the teaching of elementary school mathematics has been 
diicuiied by Hlgglns (1970). 

Certain other charaeterlstles of an activity approach result 
from research In developmental psychology* This research, recently 
sumimrized by Lovell (1972), Indicates that children should be pro- 
vided with manipulative materials which help to make abstract mathe- 
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matical Ideas more concrete* Also, children need to work in small 
groups, discussing the problems they are solving and justifying 
their aniwers. Further, the teacher's role is not that of a lec^ 
turerj but rather that a raaou^ee person who helps students to make 
their own discoveries of mathematical concepts- 

A third aspect of an activity approach is Individualization, 
for children learn mathematics differently ^ and need different learn-- 
Ing experiences p Therefore ^ the teacher needs to assess children's 
achievement and use that assessinent Information to provide Instruc* 
tion thcit Is tailored to meet the needs of each child* 

Another important feature ^ referred to by Biggi and MacLean 
(1969) as the essence of an activity approach ^ is varlety^^varlety 
in the materials used, in the problerai lolved, and in the classroom 
organization employed* Thus the teacher should use physical objects, 
as well as pictures and written materials; he should pose a variety 
of problemi related to a given idea, such as measuring on a number 
of attributes (length J areas volume, weight, time), rather than just 
one I and he should choose activities for large and small groups, as 
well as for individuals. 

Implementing an activity ^approach in the classroom Is not an 
easy task* It requires substantial changes in the teaching raethodg 
used by most teachers, as well ai a variety of Instructional ac- 
tivities and aseessment materials. In the present study teachers 
were provided with Developing Mathematical Processes (DMP) , an 
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elementary matheTnatlcs program currently under development by the 
Analysis of Mathematics Instruction Project of the Wisconain Resaarch 
and Development Center for Cognitive Learning* (For a more complete 
description of the project, see Romberg & Harvey, 1969; Harvey* 
Romberg ^ Fletcher, 1969; Harvey, 1971 1 Romberg, in preas.) 

The DMP program uses an activity approach to learning mathe-^ 
matics in presenting concepts from the areas of arithmetic ^ geometry » 
and itatistics and probability. The activities in DOT emphasize 
problems that come from the physical world of the child, and the 
findings of^ developmental piychologlsts are taken into account by 
providing manipulative materials and by giving children opportunities 
to work in imall groups t An activity approach to learning mathe=- 
matics should also provide for individual differences among students, 
and BW Includes appropriate assessment materiala .so that teachere 
can choose activities that are designed to meet the needs of indi- 
vidual children* Finally, DOT includes a variety of actlvitleB that 
give students many different opportunities to learn each new concept. 
Thui DOT is an elementary mathematics program that is appropriate 
for implementing an activity approach to learning mathematics* How^ 
ever, it is generally the case that teachers need more than just 
materiali in order to implement an activity approaeh in their claaa-- 
rooms; they alio need Iniervlce training. 
Theilnservice Program and Its Objectivei 

The Inservice program that was developad for the present study 



6 



was designed to help teachers change their performance and imple- : X 

TOnt an activity approach to learning mathematics using Dlff mate= 

rials. Unlike typical Inservice training program for mathematics 

teachers in the elsnentary school, this inservice program was in^ 

tended to be more than just a remedial course in mathematics con= 

tent. Rather 5 the inservice program was designed to help teachers 

develop the behaviors needed for implementing an activity approaGh* 

Theee behaviors , which are listed in Appendix A, deal with the 

teachers* knowledge of mathematics as well as the techniques and 

procedures used in providing and managing Instruction through the 

use of an activity approach. The developers of DOT have Identified 

these behaviors as appropriate objectives for DOT teachers , and the r 

inservice program was designed to help teachers achieve these ob^ 

jectlves , 

The objectlveg listed in AppendlK A present a description of 
^ what the teacher does when Implementing an activity approach to 
learning mathematics using the DOT Instructional program. Specify-- 
ing the desired outcomes of teacher training programi in terms of 
behavioral objectives or teacher competencies has become a well^ 
established procedure In recent years* For example, the AAAS Com-- 
mission on Science Education (1970) has presented Its guidelines 
for the preparation of elementary school science teachers in terms 
of performance obJactlveSi and the Coflmiiaslon qn Pre-Servlce Teacher | 
Education of the National Council of Teachers of Mathematice (1972) 
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±m now in the process of preparing a similar set of guidelines in 
mathematics* 

Deecribing objectives for the inaervlce program in termi of 
epaeiflc coinpetencies or behaviors does not imply that WtiiTOatlcs 
teaching is viewed as only a mechanical skill | teachliig is fm too 
complex for that* But just as an artist needs to learn the tecb^^ 
niquea upon which he builds his artistry, so does the teacher need 
competence in the techniques involved in skillful teaching v And 
once the objectives for a program are ipeciflad, they can be used 
to aisess the effectiveness of the inservlce training. 
The Questions of the Study and Their Significance 

The effectiveness of the inservice program can be determined 
in several different ways* One way is to evaluate the teachers* 
performance on each objective of the inservice program. Thus the 
first question which this etudy was deelgned to answer can be ex- 
pressed as follows s 

Question 1: What proportion of the teachers 

achieve each objective of the In^ 
service proeram? 

j 

The Importance of Question 1 is that it will identify areas of 
the inservice program that need to be Improved, providing formative 
data on the success of the training. This type of formative evalu- 
ation is a crucial step in the development of any new educational 
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product for use in schools (Scriven, 1967) j and Its Importance in 
mathematics education Is well established (Begle & Wilson, 1970)* 
Since in this case the product is an inservice program that is an 
essential part of the national installation of the WP elementary 
mathematics curriculumj the careful evaluation of the materials and 
procedures used In the inservice program is particularly Important. 
Also J the degree of success of the inservice training procedures 
used in this study will also suggest possible improvements that might 
be made in other inserviee programs for mathamatics teachers in ele- 
mentary schools. 

Another way to evaluate the effectiveness of the inservice pro= 
gram is to determine the number of teachers whose overall perfor= 
mance demonstrates that they have satisfactorily implemented an ac- 
tivlty approach in their classrooms. In this ease teacher perfor- 
mance on a set of objectives rather than on a single objective, as 
in Question 1, was used to provide a more global measure of the in-- 
service program's effectiveness. Thus the second major question of 
the study Is the following i 

Question 2i What proportion of the teachers In 

the study implement an activity approach ! 
to learning mathematics? 
The criteria used to determine whether a teacher was doing an 
adequate job of implementing an activity approach to learning mathe- 
matics were chosen on the basis of the ifesults from the pilot study | 
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the details are reported in Chapter 4, along with the pilot atudy 
data. 

Question 2 is important for several reasons. First, it pro- 
videa another means of evaluating the inservice program in terms of 
a more global measure of teacher performance, this time on a set of 
objectives that are essential for implementing an activity approach* 
Second^ in answering this question, It will be possible to detemine 
the characterlsties of teachers who fail to Implement DMP-s activity 
approach I if there are groupi of teachers for whom the inservice 
program is not adequate ^ then special training could be deyeloped 
for those teachers. In addltlonj after Identifying a teacher who 
did not implement an activity approach, the data on the students of 
that teacher can be treated separately In the assessment of the 
effectiveness of DOT* This procedure eliminates the problem of 
including students in the field test of DOT when their teacher did 
not use DOT materials in the manner intended. 

A third question to be investigated by this study is the fol- 
lowing: ' = 

Question 3: What are the characterisfclca of the 
teachers who fall to Implement an 
activity approach In their classroomp 
and are these characteristics similar 
to or different from the identifying 
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features of non-adopters of 
other innovations? 
Considerable research has been done on the adoption of Inno- 
vative practices In agriculture, medicine, and other fields, and 
attempts are now being made to relate this research to educational 
change. In this study the characteristics of non-adopters will be 
Investigated to see If the findings agree with the results of ear- 
lier rfisearch on change In education and other fields. This infor- 
mation is of theoretical interest to social psychologists and others 
who study the process of change, and of practical interest to mathe- 
maticians and educators who are disseminating innovative programs 
like DMP. 

By answering these three questions, the study can determine the 
effectiveness of a sat of procedures for an Inservlce program de- 
signed to help teachers develop certain competencies, specifically 
those competencies that teachers use in Implementing an activity 
approach to learning mathematics. 

In the next chapter the research literature related to the scudy 
is discussed. Chapter 3 describes the design of the study, and Chap- 
ter 4 presents the results of pilot tryouts of the Inservice program 
and data-gathering procedures. Chapter 5 reports the conduct of the 
study,' and the data on the teachers' performance are sumnarlzed in 
CHapter 6. The conclusions of the study are stated ini Chapter 7, 
along with reconimendations for future research. 



Chapter 2 

THEORETICAL BACKGROUND AND RELATED RESEARCH- 

There are two main areas of theory and research related to the 
problem of helping teachers implement an activity approach to learn-- 
ing mathematics. First, this study fits into the framework of teach 
©r education theory and research, since It deals with helping teach- 
ers develop the competencies relsted to an activity approach , AlsOp 
in order for teachers to demonatrate these competencies , they may 
need to change not only their own behavior, but also the organiga^'^ 
t ion and management of their classrooms and the system of soeial 
norms in the ichopl as well. Therefore^ this researck also fits 
Into the theory of planned educational change. This chapter will 
discuss the related research from each of these two areas* 

This review of the literature will begin with some general back" 
ground on the research in teacher education that provides the main : 
setting for the study! Then the particular investigations that are 
directly related to this one will be described. Similarly, the dis- 
cussion of the research on planned ©ducatlonal change will proceed 
from the general problem of Implementing educational chatige to the 
few studies that deal specifically with helping teachers implement 
new instruct ional ideas in the classroom. 
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Teacher Education Theory and Resaarch 

In recent years considerable intereat has developed in the use 
of theoretical models and a systems approach to teacher education, 
A major effort in this area has been the USOE^funded model teacher 
education programs (Clarkej 1971). The model inservice program 
proposed by Harvey (in press) Is an extension of that same approach 
applied specifically to the inservice that is needed to help schools 
implement new educational programs* 

These theoretical models include several important componenta 
that represent changes from past practice in teacher education, v 
These changes include the specifications of performance objectives 

r 

for the teachers, the provision of various types of simulated and 
real classroom eKperlences, and the evaluation of the teachers* 
achievement of the specified objectives. These changes have had a 
beneficial effect on research in teacher education. For eKamplej 
the technique of specifying performance objectives , evaluating teach^ 
era on their achievement of those objectives^ and then measuring how 
student learning is affected by chose teacher behaviors has proven 
to be a fruitful research area (Rosenshlne & Furst , 1971)* This type 
of research has provided far better results than previous attempts 
to relate teacher personality or attitude to student learning. 

While considerable research has been done on inservice training 
for teachers of elementary school mathematics ^ these studies have 
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concentrated on the mathematical achievement and attitudes of teach- 
ers rather than on the behavior *of teachers in classrooms (Ashlock S 
Herman, 19?0). However > attempts to relate teacher achievement and 
attitude to the achievement of students have not been aucceeeful. 
Fey (1969) reports a number of recent studies of elementary school 
teachers that have shown no important relationship between teacher 
characteristics (such as mathematical achievement or attltudei) and 
teacher effectiveness (measured by student achievement). This type 
of research has not revealed any important relationships in any 
subject matter area, or at any grade level (Flanders, 1969 | Travers^ 
1971; Rosenshine & Furst, 1971)* The lack of important results in 
this area has led researchers to suggest that the ef f eetivenesss of 
an inservice program ehould be judged on the basis of the classroom 
behavior of teachers, not their scores on tests of achievement or 
attitude* 

One type of teacher-education research that has focused on teach 
er behavior is the technical skills approach to teacher training 
(Berlintrj 1969). This approach is the basis for the microteachlng 
techniques developed at Stanford (Allen & Ryan, 1969) and the minl-^ 
courses for teachers produced by the Far West Laboratory for Edu- 
cational Research and Development (Borg, Kelley^ Langer & Gall, 1970) 
Research in this area has Inveitlgated such topics as the effectlve- 
ness of videotape in microteachlng as a source of information and 
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feedback for Improving questioning behaviors, tutoring techniques , 
and teacher effectiveness in eKplalning. Generally this use of 
videotape has resulted in Improveinent , and is efficient in using 
the participant's time, but more traditional methods of presenting 
information seem to be just as effective in many eases, and consid- 
erably cheaper (Berliner, 1969)* 

While microteachlng with videotape has been comparatively suc^ 
cessful^ it has been developed and used mostly with secondary school 
teachers. The implications for elementary school teachers are not 
entirely clear, and at least one attempt to replicate the effective- 
ness of microteaching on this level was unsuccessful (Kallenbach & 
Gall, 1969). However, an Inservice program using microteachlng 
methoda in order to linprove matheniatlcs tutoring in the elementary 
school claimed substantial success (Galls Dunning, & Galaisle, 1970)* 
Again In this study, it was found that using videotape was no more 
effective than providing feedback by other means, in this case, audio 
tapes (Dunning & Gall, 1971), Slinllar results were reported in an^ 
other study (Gall, Dunning, Banks & Galasal, 1972) where written 
transcripts of the videotapes were found to be as effective as the 
videotapes themselves In improving teacher questioning technlqueas 

The research on microteachlng Indicates that particular tech- 
nological advances, such as videotape, may be useful, though not 
essential^ for improving teacher education. But the identification 
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of apeGlfic teacher competencies (or technical skills) that teach- 
ers can develop and use to increase their atudenta' learning does 
appear to be a promising approach to take in improving mathematics 
teachini. 

Research on Inservice Programg 

While there have been a number of studies of inservice programs 
in elementary mathematics, they have considered only changes in 
achievement and attitude; no research has been found that deals with 
helping teachers develop the particular competenclea involved in 
implementing a new elementary mathematics program. However ^ there 
is some related research in other subject-matter areas of the ele- 
mentary school • 

In the area of elementary science programs ^ Ashley (1967) stud- 
ied the effect of inservice training on the teachers of the AAAS 
program Sclence"--A Process Approach , The inservice pifogram con- 
sisted of eleven meetings over a period of six months. This program, 
however, did not appear to cause an Increase in the desired teacher 
behaviors. Moreover, there was a negative correlation between the 
teachers' implementation of desired strategies and positive teacher 
attitudes toward the program* The reasons for these rather unuaual 
developments are not clear, but it seemi likely that one of the main 
difficulties was the quality of the instruments used. For example, 
the observation schedule used a number of rather vaguely worded Itemi, 
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such as ^'Teacher recognlges the limitations of one experlinent for 
tha understanding of all students." This would be a very difficult 
behavior to obaerve* 

A similar research study was conducted using teachers who 
attended a three^week inservice workshop dealing with the Science 
Curriculum Improvement Study materials (Bruce, 1970). Againj mea= 
sureg of teacher attitude and personality did not appear to be re'- 
lated to the teachers^ pefformance in the classroomi however ^ anal- 
ysis of the teachers' verbal behavior did show that they were using 
more high-level questione after the inservice workshop. Thomson & 
Voelker (1970) report replicationa of this change in questioning 
behavior by other teachers of new elementary science programs* 

Askov (1970) reported considerable success in helping teachers 
impletnent an individualized reading program. The inservice training 
GOnaiited of a series of six meetings held during the school year, 
Aakov founi that teachers changed their classroom managament prgce- 
dures by providing a variety of instructional materials and by teach'- 
ing children in groups of differing sizes. And in a pilot study of 
a training program on teachers' classroom management procedures^ 
Lelnhardt (1971) was successful in developing certain skills ex- 
pected of nursery and kindergarten teachers who attended a workshop 
of the Primary Education Project from the Learning Research and 
Development Center in Pittsburgh, 
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These investigations of the effectiveness of itiservica train= 
lug programs indicate that teacher behavior can be changed , but they 
provide little guidance as to what kinds of Inservlca programs might 
bft moat successful* More information on this point ±3 provided by 
th research on planned educational change. 
Theory and Research on Planned Educational Change 

The literature on planned change is wide in scope and vast in 
quantity, Havelock (1969) reviewed approximately 4000 sources In 
his analysis of the theoretical concepts and the research evidence 
dealing with change in education, agriculture, medicine, and other 
fields t This section of the report will discuss t) 1 major theo-- 
ret leal perspectivei on change, the specific research studies that 
deal with helping teachers change their behavior ^ and the impli-- 
cations of this research for inservice programs. 

The many theoretical models of the change process in education 
range from the research-development^dlf fusion perspQctive, asso- 
ciated particularly with Cuba (1968)^ to what Havelock (1969) calls 
the human relations tradition of planned change ^ with its emphasli 
on group dynamics. These models vary considerably, but they all 
deal with the same basic elements that are involved in educational 
change — ^the client system (teacheraj in the present study) ^ the 
social structure of the schoolp the change agent and his relation-^ 
ship to the teachers ^ and the characterlatlci of the Innovation 
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itself* In the study reported In this paper the focus is on teach= 
ers and their relationship to educational change. (For a more com- 
plete discussion of the various theoretical perspectives on planned 
educational change and their relationship to Implementing an activity 
approach to mathematics in elementary schools , see Romberg, McLeodj 
5? Montgomery, 1971,) 

The research on change which is most closely related to this 
study deals with the characteristics of innovative teachers and with 
the difficulty of helping teachers change. On the basis of research 
in a number of fields^ Rogers (1965) predicted that innovative teach'- 
ers would be younger ^ more educated, more Gosmopolitan, and more 
likely to be viewed by other teachers as nonconformists. So far, 
however, no definite relation has been shown to exist between inno- 
vative teaching and the teacher's age (ERICj 1970). No research has 
been found that focuses on the relationship between innovative teach- 
ing and the teacher's education or cosmopolitan quail tiea. 

A number of studies have Investigated the difficulties of help= 
ing teachers change their classroom practices* The most extensive 
of these studies, reported by Goodladj Klein, and Associates (1970), 
deals with 158 classrooms in 67 urban elementary schools in 13 states. 
They investigated the teachers' ii^lementation of new ideas in sev= 
eral areas, inGluding the use of objectives, inquiry teaching, in= 
dlvidualiaatlon, group dynamics, and modern mathematics programs • 
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The findings were unlfdrmly negativei In spite of the fact that 
teache^^ often said they were individualizing instruction or using 
inquiry methods^ for eKamplej Qbservars did not see these practlcea 
being implemented in the classroomi Instead ^ what the obiervers 
law consisted of teachers "covering material" rather than teaQhlng 
toward specif Ic objectives^ teachers telling students the answers 
rather than using inquiry methods , teachers conducting class in 
large groups with almost no indlviduallEed instruction, and teach^ 
ers controlling all student interactionj with no opportunity for 
small group work — in fact, student Interaction was largely dls= 
couraged. There was some evidence of curriculum change , partic- 
ularly In mathematics I but in spite of the emphasis on new content 
in the mathematics being taught ^ the old teaching practicei still 
prevailed. This study indicates that teachers are not implementing 
new ideas in their classrooms, even when they seem to believe that 
they are- this fact underlines the important role that inservlce 
training must play In helping teachers change their practices ^ 
These teachers ^ incidentally, came from schopls that are similar to 
most of those involved in the present study* 

Another study of educational change in the elementary school 
has been reported by Gross (1969), In this study of an eKperimental 
school, teachers were asked to change their role to make it more non 
directive. The teachers, adminlstratore and the coranunlty were all 
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in favor of this change initially, and yet it was a complete failure 
within alK months* By that time most of the teachers had given up 
even trying to implement the innovative techniques. Gross believes 
that the main reason for this was the lack of continued support and 
training for the teachers during the early stages of implementing 
the innovation, and recommends that inservice training be continued 
during at least the first few months of an implementation program 
that wants to change teacher behavior. 

In another study of educatlonl change, Carlson (1965) reported 
that the teacher's ■■need to perform" in the role of lecturer often 
caused Inappropriate use of programmed instruction. Rather than 
letting children proceed at their own pace, teachers tried to slow 
down the faster students and speed up the others^ apparently so that 
the students could be taught in a large group, thus satisfying the 
teacher' g need to perform. Again in this case there was no substan- 
tial inservice training program and tlie innovation was not imple= 
mented successfully. 

Other studies of change at the secondary level have also indl= 
cated the difficulties involved in changing teacher performance • 
Herron (1971), for examplei found that teachers of new secondary 
school science programs were not adequately prepared to explain the 
point of view of the material they were using* And in a Swedish 
study of Dahllof, Lundgreni and Sloo (1971), secondary school teach'- 
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ers, who were supposed to give students additional opportunities 
for interesting independent study projects, instead provided only 
additional homework * 

In all of these studies of educational changes it appears that 
inaervlGe training would be a reasonable way to improve the chances 
for succeii of an innovation. Also, when the innovation is a com- 
plex one involving substantial change in the behavior patterns of 
teachers, the Inservice program should continue for several months 
after the teachers start using the Innovation. This makes it pos-- 
Slble for the inservice program to deal with the difficulties that 
teachers have as they attempt to adapt their teaching to the require 
ments of the innovation. 

The research results eunmiarlEed in this chapter were used in 
planning the Inservice program designed to help teachers Implement 
dot's activity approach to learning mathematicSi A description of 
the inservice program is Included in the next chapter* 



Chapter 3 
THE DESIGN OF THE STUDY 

As an Investigation of the effectiveness of an Inservice pro-- 
grain for mathematics teachers , the study reported here can be claeal= 
fled as deciiion-oriented or developraent^oriented rasearch (Cronbach 
^ SuppeSj 1969) I that is, the study was daEigned to answer^ specifics 
practical questions about how well the inservice program achieved 
the objectives set for it^ rather than being designed to provide 
general conclusions about the effectiveness of various types of in^ 
service trainingi Since this is a practical study of teacher per^ 
formance, the setting of the study is in schools , not in a labora- 
tory, and the study has been designed to fit unobtruilvely within 
that school setting* This chapter describes the setting and design 
of the study, the inservice program, and the instruments and proce- 
dures used in evaluating that inservice program. 
The Setting of the Study 

The itudy was carried out in connection with the 1971=72 small- 
scale field test for the kindergarten and first grade levels of De- 
veloping Mathematical Processes (Dfff), The small-scale field test 
is an intermediate stage of the developmental sequence for DIff 
(Harvey, Romberg^ & Fletcher, 1969), following the initial tryouts 
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of the pilot developmant stage and preceding large-scale field test- 
ing and comnerclal publicationi The purpose of the field teats is 
to determine the effectiveness of the DOT program in a variety of 
settings. Schools that participate in field testing normally vary 
on a number of dimensions; they may be urban ^ suburban, or rural, 
for example* Also^ schools may follow the traditional organiza-- 
tional pattern of self-contained classrooms , or they may be multi= 
unit schools associEted with the Wisconsin Research and Development 
Center's program of Individually Guided Education (Klauameiar, 
Quillingj Sorenson^ Way^ & Glasrudj 1971). 

The organizational pattern of multlunit schools is Illustrated 
in Figure 1* These schools are organised Into units of about 150 
students s where each unit 'is taught by a team of teachers and aides. 
The number of students in the unit and the planning time made avall^ 
able to the teachers are key factors that enable the staff of the 
unit to work together in providing individually guided instruction. 
For example 5 teachers can identify groups of student. -3 with similar 
needs p and then plan different instruction for different groups of 
students according to the needs of each group* The DOT materials p 
while appropriate for self-coiitained classrooms , are designed to 
make particular use of the capabilities of the multlunit schools. I 
Similarly, the inservice program and evaluation procedures of the 
present study were designed for all the teachers in the field tast, 
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although it was recognized that teachers in multiunit schools would 
have some advantagee in achieving certain objectives of the lnser= 
vice program, 

When teachers agreed to participate in the field test^ they 
knew that they would receive BKP materials and Inservice training. 
They were also Informed of regular field test procedures for gather^ 
ing data. For example, teachers were asked to cooperate with the 
field test staff by providing information on studenta' reactions to 
the materials, on the teacher's own reactions to the materials , and 
on ways to Improve the materials. In addition, the teacher knew 
that observers would visit DMP classrooms to gather more information 
on the children's responses to the materials and nn how DMP could be 
improved. 

The evaluation of the inservice program was designed to be an 
i 

Integral part of the field test; that is, the information gathered 
from teachers was to be obtained as a part of the regular field test 
procedures* Data were to be collected in a variety of ways. First, 
classroom observationi of teachers would be carried out as a part of 
the observations of children -s reactions to DMP. Second, teachers 
would be given questionnaires that asked them to report on how they 
had used thp materials and on their racommendationa for improving 
the materials* Third, since a random sample of Dlff classrooms was 
chosen for the purpose of gathering data on a sample of students in 
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the field test, the teachers of these students would be interviewed 
briefly with regard to their own records of student perf Drmance . 

All of these data to be gathered unubtrusively | the observation 
procedures were designed so that teachers would not feel that the^ 
were being evaluated. Rather^ the teachers were to be actively in-- 
volved In evaluating Dtff materials and the Inservlce program^ The 
design called for teachers to be treated as colleagues whose opin= 
Ions were valued ^ not as subject i in an experiment* The next sec=- 
tlon of the report presents an overview of the design of the study* 
The Elements of the DesiRn 

The main elements of the design of the study, the inservica 
program and the evaluation procedures , are outlined in Figure 2* 
The Inservlce program was designed to be carried out in a two-day 
workshop (W) before the start of school, followed by four one--hour 
inservlce meetings (IM) during the first eight weeks of school. 
After these four meetings, field teat meetings (FTM) were to be 
held abput every two weeks until inld= January * these meetings were 
planned to be shorter , lasting about half an hour*. The main purpose 
of the field test meetings was to obtain responses from the teachers 
about the materials ^ rather than dealing with inservlce topics. 
The details of the design of the Inservlce program, along with a 
rationale for its development, are reported in the next section of 
this chapter. 
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The othar main part of the design represented in Figure 2 is 

the evaluation procedureS''^classroom observations, questionnaires, 

and interviews. The observations were to be carried out by the ^ 

same persons who conducted the inservice meetings and the field 

test meetings. During the first three classroom visitations (V), 

the observers were to gather information on the students' reactions 

to the materials, but not oft teacher behavior. The data on teacher 

performance were to be obtained after the inservice program was 

eomplete and the teachers were accustoined to having the observers 

In the room. The presence of an observer usually tends to cause 

teachers to change their behavior ^ but the effect of the observer 

on the teacher normally decreases with each visit (Jackson j 1965; 

Webb, Campbell, Schwartg, & Sechrlst, 1966), In the present study 

it was expected that the effect of the observers on the teacher 

/ 

would be Insignificant no later than the third visit* 

After the first three visits ^ the design calls for clasaroom 
observations of teacher bthavlor (0), The four days of observatlone 
were scheduled about every two weeks (with a break for Christmas 
vacation) from November to January.^ from the time the inservice meet- 
ings ended until the conclusion of the first semester* More detail 
on how these observations were carried out is included in the section 
on evaluation procedures later in this chapter* 

In addition to the obaervatlons , three questionnaires (Q) were 
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to be administered to all of the teachers at the end of the first 
semeBtert These questionnaires asked the teachers about their teach^ 
tng practices^ their knowledge and opinions of the programj and their 
educational background* In additions some information on the teach^ 
ers' use of DOT materials was to be obtained through intervlewa (I) 
with teachers from a random sample of field^test classrooins. 

As indicated in Figure 2, the time epan covered by the study 
was about one semasterj with the first half spent priinarily In in- 
service trainings and the second half In the evaluation of the effec- 
tiveness of the training* Half of a semester was decided upon as 
a reasonable length of time for teachers to adapt their teaching 
strategiee to DMP'e activity approach to mathematics- If a teacher 
had not adopted the behaviors involved in an activity approach by 
the second half of the semester ^ then the inservlce program would 
be considered inadequate for that teacher. The criteria for deter= 
mining the adequacy of a teacher's performance were based on data 
from the pilot study; these criteria are described in Chapter 4, 

In addition to the baie=llne data generated from the pilot 
study J it would have been useful to have obtained "preteet" data 
by observing the teachers in their omi classrooms during the year 
before they started using DOT. However i since the teachers and 
schools that participated in the field test were not selected until 
the summer of 1971 ^ no pretest was possible. Instead, it was de= 
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elded to ask teachers CQuestionnalre C) how their teaching prac- 
tices had changed since the previous yeari Chapter 6 will sunroarl^e 
the responses of the participants in the study. Another way to 
compensate for the lack of a pretest Is to use the data that other 
studies hava reported on teaching practices that are conmion In 
schools similar to those involved in this study (Goodlad, Klein, & 
Associates, 1970); while these data do not allow us to make meaning- 
ful statistical comparisons between groups of teachers , they pro- 
vide useful background informatloh for making practical declBlons 
about the ef f eGtiveness of the Inservlce program. 

This section of the report has presented an overview of the 
design of the study. The chapter continues with a more detailad 
discussion of the main elements of the dealgn==the inservlce program 
and the evaluation procedures. 
The Inservlce Program 

The purpose of the inservice program is to help teachers imple- 
ment an activity approach to learning mathematics/* The specific 
competencies that teachers need In order to implement an activity 
approach with DOT materials are found in Appendix B| these compe^ 
tencleg are stated as behavioral objectives for DMP teachers and 
were used in designing and evaluating the Inservlce program. These 
objectives were specified by the developers of DMP as being lrapor= 
tant for the appropriate implementation of DMP's activity approach 
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to learning mathematics. 

The design of the inservicr. training follows the reconimenda- 
tions for a model inservice program proposed by Harvey (in press). 
The main components of the model include (1) providing teachers with 
information about the content to be taught and the techniques to be 
used 5 (2) providing for simulation of an activity approach as a 
part of the inservice trainings and (3) continuing the inservice 
program through the initial period of the classroom implement at Ion* 
The first two components of. the model were to be Included in a wgrk" 
shop for teachers conducted before the beginning of school, while 
the third coii^onent was to be carried out through the series of In- 
service meetings planned for the first semeetar after the inservice 
workshop* By beginning an inservice program with a workshop ^ teach- 
ers are provided with the knowledge of the new materials and proce^ 
dures that appear^ to be a necessary prerequisite to getting started 
with an innovative program (Bessent ^ 1967); the continuing inser-- 
vice meetings give teachers the support and encouragement that they 
seem to need during the first few months of implementing new ideas 
in the classroom' (Gross , 19693 i 

The Insegvlce workshop * A great deal has been written about 
ways to improve inservice education (for example, Rubin, 1971), 
but there is little research evidence to guide the development of 
inservice workshops j as was seen in Chapter 2, Therefore ^ each 
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developer needs to determine how best to design an Inservlce work- 
shop in terms of his objectives. In the present study, the design 
of the ineervlce workshop wag guided by the objectives for Dlff teach= 
ers listed in Appendix B» 

The basic strategy for the workshop was first to have teachers 
participate in a simulated activity-approach classroom; then^ after 
arousing the teachers' Interes.t in an activity approach ^ the work-- 
shop would continue with a more thorough eKamination of what a taach-= 
er needs to know and to dp in order to impleTnent D^DP and Its activ- 
ity approach to learning mathematics # Therefore , it was planned that 
the ineervlce workshop would begin with a mathematical activity for 
teachers that introduced them to an activity approach (see the sample 
agenda in Figure 3)* Two activities were chosen to be used In the 
inservice workshop | they are included In Appendix C* These activities 
were selected primarily because they would provide an opportunity for 
the workahop leader to illustrate many of the behaviors related to 
an activity approach, and give the teachers a model on which to base 
their OOTi behavior* This modeling procedure Is believe to be an ef^ 
fective way to change teacher performance (Berliner, 1969). During 
the activity the teachers would be asked to solve problems while 
working in small groups , to make hypotheses , and to validate their 
hypotheses* Empirical validation would be emphasised ^ while valida- 
tion by authority would be discouraged. The activity would conclude 



AGENDA 

Inservlce Workshop for DKP Teachers^ 



D ay 1 Topic 

9:00-10^30 An Activity Approach to Math 

10:30 - 12 1 00 Overview of DOT Materials 

12:00 - 1:00 Lunch 

1:00 = 1:30 Mathematical Processes In DOT 

1^30 - 2:30 The Mathematlci Included In DMP 

2i30 ^ 3:00 Field Testing R and D Center Materials 

Day 2 

9^00 - 10*30 Using DMP Activities 

10:30 - 12:00 DOT - Assessment Itoterlala 

12:00 - 1:00 Lunch 

llOO - 2 1 00 "Using a Mathematics Laboratory Approach' 

, Film and Dlicusslon 

2:00 = 3:00 Planning Time 

Figure 3* A Sample Agenda from a Sumner Workshop 
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by having each group present a display of their findings and by 
discuaaing which of the hypotheses appeared to be correct and which 
did not. After the activity, the procedures that make up an activ- 
ity approach would be discussed with particular relerence to the 
activity just completed by the teachers* Thus the workshop would 
begin with both an illustration and a discussion of the desired 
teacher behaviors involved in structuring an activity (Objectives 
3-6) J in Interacting with students (Objectivea 7=10), and In orga= 
nlzlng the clasarooiii (Objectives 11-15), 

The plan for the workshop continues with an overview of the 
Instructional and assessment materials used in DOT; these niaterials 
Include manipulatlves^ printed matter for teachers and children ^ 
pupil performance records , and assessment instruments. The dis- 
cussion of the materials was designed to help teachers see how they 
Could provide an activity approach to leading mathematics in their 
classroom through the use of DMP instructional activities (Objec- 
tives 1-2) and assessment procedures (Objectives 18-24). It was 
planned that the overview of DIff materials would be followed by a 
detailed discussion of the mathematical processes emphasl2ed by 
DMP and a description of the geometry and arithmetic topics that 
make up the first two levels of DMP (Objectives 16-17)* 

The first day of the workshop would conclude with a dlecussion 
of the field test purposes and procedures. The teachers were to be 

EKLC 
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Informed of the continuing sequence of tryouts and revisions of DJff 
materials in which they were now to play an active rolej and the 
field test staff would outline the data-gathering procedures, in-- 
eluding the classrooin visits to observe students as they worked with 
DOT materiala and the testing prograin that would be used to deter-- 
. mine the students' achievement in Tnathematlcs, 

The workshop's second day was to begin with a more detailed 
look at DOT instructional activltles-^thelr organiEation, □bjectiveSj 
and sequencings — and the related asaesament procedures , such as place 
ment and achievement tests. During this time the teachers could be 
shown how the instructional and assessment materials would fit to- 
gether in a specific activity. The activity included in this part 
of the workshop was chosen to illustrate important mathematical pro- 
cesses (Objective 17) and a variety of assessment procedures (Ob- 
jectives 18^24)* 

The workshop would continue with '*Uslng a Mathematics Labora- 
tory Approach," a film produced by the Project for Interpreting 
Ifathematlcs Education Research of Pennsylvania State University* 
The film reviews some of the research on the ef fectivsness of cer- 
tain aspects of an activity approach, and illustrates some of the 
procedures 5 such as the use of manipulative materials by children 
working In small groups* The discussion of the film and its rela- 
tionship to DMP's activity approach was to be followed by a short 
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planning period when teachers could ask questions and begin prepar- 
ing for their first day's instruction using DOT* Thus the inser- 
vice workihop would conclude with a time for answering individual 
questions from teachers on how to Implement an activity approach. 

The inservice meetlnss. As indicated in Figure 2^ the inser- 
vice meetinga were to be held approKlmately every two weeks during 
the first two months of the school year. The schedule of inservice 
meetings follows the reconmiendations of Gross (1969) for continuing 
the inservice program through the initial implementation period. 
The topics discussed during these meetings, which are listed in 
Figure 4j reviewed and expanded on ideas presented during the ini- 
tial workshop. The topics were sequenced as Indicated in Figure 4 
In order to help teachers with the problems of, initiating an activ- 
ity approach (Meeting 1) and BMP assessment procedures (Meeting 2) 
before attempting to refine the teachers' conception of an activity 
approach (Meeting 3) and their knowledge of the mathematics in Dtff 
(Meeting 4) • 

The first meeting was designed to help teachers with the prob- 
lems of getting an activity approach started in their classroom. 
The discussion would center on choosing , organizing, and preparing 
for activities, and would give teachers a chance to share problems 
and exchange possible solutionB, The second meeting would extend 
the discussion of the assessment, materials that was begun in the 
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Inservlce^ jteetlng Topic Date 

Meeting li Managing an Activity Approach Mld^ September 

Chooaing activities 
Organising an activity 
Preparing msterlals 

Meeting 2i DOT Assessment Procedures " Early October 

InstruTnents 

Records of student achieve^ 
ment 

Providing individually guided 
education 

Meeting 3: "An Activity Approach to Math" Mid^Oetober 

Discussion of the pamphlet 

Suggestions for improving 
the pamphlet 

Meeting 4: ■'Mathematical Proceisei'' Early November 

Discussion of the pMiphlet 

Suggeations for improving 
the pamphlet 



Figure 4. The Schedule of Inservice Meetings 
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workshop and would emphasize ways that the teachers could use the 
aasessment information that they would be gathering. The focus for 
the third and fourth meetings was provided by two pamphlets for DMP 
teachers j "An Activity Approach to Math"- and '^Mathematical Processes* 
In each meeting one of the pamphlets would be discussed and teachers 
would be asked to suggest ways to improve the pamphlets. 

The plan for each meeting also included a time for teachers to 
ask questions and to suggest revisions In DMP materials. In addi- 
tion ^ teachars were to be encduraged to share information on tech- 
niques or activities that had been particularly successful, or un-- 
successful J so that they could learn from each other's eKperiances* 
At every meeting, an attempt would be made to provide an atmosphere 
of Bupport and encauragement for the teachers | they would never be 
criticised . Rather ^ the intent was that the positive atmosphere 
would strengthen the group norms of the set of participating teach-- 
era in each school, thus supporting the teachers as they changed 
their behavior in order to implement an activity approach to learn- 
ing mathematics. 

It was anticipated that some changes would be needed to adapt 
the Inservice program to the needs and achedules of the particular 
schools involved in the study. Thus a pilot study of the Inserviee 
program was undertaken. The results of the pilot study and its 
effect on the Inservice program for the main study are reported in 
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the next chapter. The details of the conduct of the Inservlce pro- 
gram of the main study are described In Chapter 5. The next section 
discusses the other main element of the design— the evaluation pro^ 
cedures , 

The Evaluation Procedures 

As Indicated earlier in this report, a substantial amount of 
research has shown that teacher characteristics do not seem to be 
related to teacher effectiveness, but certain teacher behaviors 
apparently are. To put it another way, the crucial point In teach- 
ing mathematics in the elementary school seems to be what the teach- 
er does, not just how much the teacher knows. Similarly, in a study 
of teacher training procedures, the main evaluation technique shoiild 
be classroom observation of what the teacher does, not just question- 
naires, that measure what the teacher knows. 

While observation was the basic technique for gathering data 
in this study, questionnaires and Interviews were also to be uti- 
lized, following the recommendation that multiple measurements of 
phenomena should be used where possible (Webb, Campbell, Schwartz, 
& Sechrlst, 1966). This section of the chapter will discuss the 
evaluation procedures— observations , quastionnaires , and interviews; 
the related instruments are included In Appendix B. 

The observa tion schedule . The main technique to be used for 
evaluating the effectiveness of the inservice program was classroom 



40 



observation of teacher performance. Many instruments have been de- 
veloped to analyze classrooni behavior; Simon and Boyer (1967) have 
collected 17 voluines of dhenij and new or refined instruments are 
continually being developed for special purposes (Resnicks 1971; 
Reynolds, Abraham, 6r Nelson^ 1971). However^ none of these instru- 
ments was appropriate for this study, for two main reasons. First, 
no Instrument was found that assessed most of the behaviors Involved 
in implementing an activity approach , and second, most instruments 
were designed to be used by an observer who was clearly recording 
teacher behavior. Such instruments were not appropriate for this 
study with its requirement for unobtrusive measures. Therefore, it 
was necessary to construct and try out an observation schedule for 
this study. 

FQllowing the recommendations of Medley and Mitgel (1963) and 
in line with the needs of the study, an observation schedule was 
developed using a "sign system""that Is^ only certain behavior is 
reeorded~aa opposed to a "category spstem," where all behavior is 
classified into a few mutually eKclusive categories. As many as pos- 
sible of the teacher behaviors related to an activity approach were 
included in the observation schedule. Those behaviors that were 
not normally observable in the classroom were assessed by question- 
naire or interview. 

In addition to recording the occurrence of certain behaviors. 
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the observation schedule also describes the context in which the 
behavior took place ^ including the activity ^ its purpdsas, and the 
point (Qpenlngj middla or closing) at which the observation occurred. 
While many classroom observation systems do not take it Into account, 
the importance of the context of particular behaviors is now being 
recognised (Nelson ^ Raynolds^ 5r Abraham^ 1971), ^ Whether a speci- 
fic behavior is appropriate or not often depends on the requirements 
of the activity in which the teacher is involved* For example, in 
an activity approach, some lessons call for students to work in a 
large group under the teacher's directionj while other activities 
require that the teacher organize the students Into small groups. 

After recording the teacher's behavior and the context in which 
the behavior occurred, the observer can Judge the appropriateness 
of the behavior* For example^ if the observer notes that the teach- 
er is working with the class as a large group in an activity that 
called for small groups ^ the behavior would be recorded and marked 
inappropriate for that activity* In this way^ the observer records 
teacher behavior and then> considering the context ^ judges whether 
or not the teacher has demonstrated the desired behavior* 

Obgervatlon procedureg , As indicated in Figure 2, observers 
were to be in each school on seven separate days from September to 
January* The announced purposes of the visits were the same through- 
out the itudyj the observerB came to see the students as they used 
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D>ff materials and to conduct ineetings (itiservice Tneetings or field 
test meetings) with the teachers. However » during the Iset four 
visits the obaervers also gathered data on teacher behavior. While 
the obaervers changed their emphasis from only Tnaking notes on stu- 
dent behavior to also recording teacher behavior^ they were not to 
change their actions in the classroom in ways that 'teachers or chil- 
dren would notice* 

Due to financial and time limitations * atudles of this type 
are usually designed to have only one observer in a school* on a 
given day. Since up to three or four teachers at the same grade 
level may teach mathematics at the same time, one observer could 
not be present for all of each class. Therefore, It was neceBsary 
to decide between sampling teachers or sampling time. 

The alternative of observing a sample of teachers was rejected; 
for the purposes of this study ^ it was deemed more important to have 
information on all of the teachers than to have more detailed ±nfdr= 
mation on only a few of them. Also, it seemed desirable to give the 
teachers equal treatment when possible, since past experience with 
DOT teachers indicated that some of them felt left out if their 
students were not observed* In addition^ it was important to see a 
teacher on all four observation days, if possible , before making any 
judgments about the teacher's performance, Therefore, it would not 
have been desirable to observe one teacher for an entire class ba- 
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cause this would have meant that some teachers would have been ob^ 
servad only on one day. Several modifications of these procedures, 
were alBo considered § but time sampling appeared to be the best 
alternative for the purposes of this study. 

The time--eampllng procedure was (1) to spend about five minutes 
In the classroom to becotne familiar with the activity and other as^ 
pects of the context In which the teacher behaviors occurred , (2) to 
observe for five minutes the behavior of the teacher^ (3) to record 
unobtruaively the results of the observation, and (4) to repeat the 
procedure with the next teacher to, be observed during that class 
period. If there was no other teacher to be observed at that times 
the procedure was to be repeated with the same teacher. 

When there was more than one teacher to be observed during the 
same class period^ the order In which the teachers were observed 
would be determined at random* The obaervations would start with a 
different teacher each day so that the observer would have the op- 
portunity to see each teacher during the opening of at least one ac- 
tivity. Once the cycle was completed and each teacher was observed 
during the beginning of an activity , a new random order was to be 
chosen and the observations continued. 

The time-sampling procedure has many advantages. It allows 
the observer to see each teacher on each day^ providing a good idea 
Q of the different activities being used by the teacher. The five- 

ERIC 
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minute period of observation is long enough so that the teacher can 
be assessed on the behaviors, and atlll it is sufficiently brief 
so that all the teachers can be observed on a given day* 

After each observation, the observer was to record whether or 
not a particular behavior had been demonstrated at least once during 
that five-minute period. This periodic note-taking by the observer 
took very little time and was much less noticeable than the other 
coffimon procedure for classroom observation of tallying the occurr- 
, ence of teacher behaviors. In addition. Medley and Mltzel (1963) 
report that the number of times a behavior occurs at least once in 
a number of five'-minute periods is highly correlated with the number 
of times the behavior occurs over much longer time segments* Thus 
the procedure of recording the presence or absence of a behavior 
should be as accurata as, and less obtrusive than^ tallying the 
^number of times the behavior occurred * 

One other aspect of the observational procedures was an impor=« 
tant factor in the design of the study. In order to control for any 
effect due to differences between the observers , either in terms of 
their observations or their conduct of the inservice meetings^ it 
was decided that each observer should spend the same amount of time 
in each eehool* This balancing was to be carried out by establish- 
ing a schedule of visits where the two observers alternated in 
traveling to each school that participated In the study* A more = 
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detailed r*:jport of the activities of the observers is found in 
Chapter 5* 

In addition to the classroom observations, data were also to 
be gathered by questionnaire and by interviewt The next section 
discusses the questionnaires. 

The qu^etionnaires t Not all of the behaviorB that are related 
to an actlvity^ approach could be assessed by observation. For ex- 
ample ^ it would be difficult to know if the teachers were kaepln| 
records of student achievement (Objective 18) or if they could choose 
activities designed to teach a particular concept (Objective 21) 
just by observing their clasaes. Therefore, Quescionnaire A was de^ 
veloped to assess some of the objectives of the inservice prograjm* 
While Questionnaire A was developed to assess specific objec^ 
tives^ it also had a broader purpose—to gather all kinds of Infor^ 
mation from teachers on ways to Improve Dtff materials* This purpose 
made the queatlonnalre a useful way for the teacher to express her 
views as well as a means of finding out how the teacher performed 
on certain objectives. ^ Questions about what the teacher had done 
were included along with requests for ideas on how the materials 
could be Improved. 

All of the teachers in the study were to complete Questionnaire 
A; it was to be administered during the mid-year workshop at the end 
of January. Questionnaires B and C were also to be given to teachers 
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at the mid--year workshop » Questionnaire B gathered descriptive 
information on the teachers' background and professional activities, 
while Questionnaire C assessed teachers' attitudes, opinions, and 
previous teaching practices. Portions of Questionnaires B and C 
were based on instrument s uied'for similar purposea in the National 
Longitudinal Study of Mathematical Abilities conducted by the 
School Mathematics Study Group (Traverse 1971)* Each of the three 
questionnaires was tried out initially with experienced DMP teachers 
and revised twice before being used in the study. The questionnaires 
are included in AppendlK B. 

Interviews . In addition to data gathered by observation and by 
questionnaire^ it was planned to interview a random saniple of teach- 
ers in each grade level on the records of student achievement which 
they kept. The interviews were to be carried out by field test staff 
as a part of regular field test procedures. These procedures in^ 
eluded selecting a random sample of students in December and February 
in order to monitor student achievement* The teachers of these stu^ 
dents were to be asked to provide whatever records of student achieve= 
ment they had in order to assist the Interviewer in assessing the 
children. The Interviewer would then report the type of records that 
the teacher kept along with the data on student achievement. 

Rating teachers o n the objectiveg . It was planned that each 
teacher in the study would be rated on each of the objectives listed 
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in Appendix B, The ratings to be used Were mastery , non-mastery , 
and inGoncluaive f The data on which the ratings are based are re^- 
ported in Appendix D* 

The rating of inastery for an objective wQuld be assigned to 
teachers who demonstrated the desired behavior in 75% of the obser- 
vations during which the behavior was appropriate . The Tnastery 
level of 75% was chosen because it allowed for the possibility that 
a teacher might have one bad day out of the four days of observation. 
When an objective was to be assessed by observatlonp the teach- 
er had to be observed at least three times before a rating of mas- 
tery could be aislgned. Teachers who were observed not more than 
twice would be given non--mastery or inconclusive ratings, depending 
on their perfdrmance up to that point. This prqcedure was adopted 
to Insure that the performance of the teachers would be more likely 
to be underrated than overrated ^ thus preventing any overestlmation 
of the effectivaness of the inservice training due to a lack of ob- 
servations- 
Responses on Questionnaire A that were related to objectives 
were also given ratings of inastery, non-mastery, and inconclusive ' 
(when there was no response). For objectives that were assessed by 
more than one procedure , the source of information that was be-- 
lieved to be most reliable received the most weight In making the 
ratlngt The details of what constituted mastery in each of these 
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situations U de.crlb.d 1„ Chapter 6 along with th. data on teacher 

performance* 

Once the teachers have been rated on each objective, the two 
rao.t linportant questions of tha study can be answered. Thaa. qu.a=^ 
tions, stated originally in chapter 1, are aa follows: 
Question 1: What proportion of the teachers 
achieve each objective of the 
Inservlce program? 
Question 2, What proportion of the teachers In 
the study linplement an activity 
approach to learning niathematics? 
In order to determine what proportion of the teachers should . 
achieve each objective m order for the Inservlce progra. to be con^ 
sidered successful, performance criteria needed to be set. The 
ratings of the teachers could then be co.„p.red to the speMfled 
criteria in order to evaluate the effectiveness of the Inservlce 
program. , Mther than setting arbitrary criterion levels for ads= 
quate achievement of each objective (Question 1) and for adequate 
implementation of an activity approach (Question 2). a pilot study 
of the evaluation procedures was carried out with sKperienced DM' 
teachers. The results of the pilot itudy were used in setting 
_ appropriate performance levels for the teachers in th. main study. 
^ The pilot atudy and the performance criteria generated from it are 
ER|C- reported in the next chapter. 



Chapter 4 
THE PILOT STUDIES 



Before this study was conducted 3 the niain elements of the de^ 
sign 5 the Inservice program and the evaluation procedures , were 
triad out with teachers. The circumstances of the tryouts varied 
considerably; the observation schedule^ for examples underwent ex= 
tensive pilot testing over a period of approximately two mdnthSs 
while some portions of the Inservice program were tried out only 
brleflyt This chapter reports the tryouts of both the Inservice 
program and the evaluation procedures^ and concludes with a descrlp-= 
tion of how the data gathered in the pilot studies Influenced the 
setting of the performance criteria that were used in the main study* 

Tryouts of Components of the Inservice Prograin 

The inservice program was made up of two main parts— the work- 
shop for teachers at the beginning of the school year and the aeries 
of Inservice meetings during the first semester. The first part of 
every workshop was always an activity for teachers | its purpose was 
to Illustrate an activity approach to learning mathematics. Two of 
these activities were tried out with teachers and others who^ atten- 
ded an inforTnatlonal meeting on DOT during March 5 1971. Wiile most 
of the participants were teachers ^ a substantial minority were 
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administratora, including superintendents, curriculiira speclaliste^ 
and principals- The meeting lasted for about an hour and a half, 
and over two-thirds of that time was spent working on the actlvltias 
and then discussing them* 

Participants were asked to evaluate the meeting in terms of the 
value of the information presented and the quality of the presenta= 
tioni about half of them did. Of the 20 questionnaires received, 
about 70% said that the information received was useful and that the 
quality of the presentation was high. While it was not always pos- 
sible to identify which of the respondents were teachers, it appaar-^ 
ed that at least some of the low ratings came from administratora 
who were more Interested in factors such as the cost of materials 
than in how DMP could be used to ImplCTient an activity approach to 
learning mathematics. Thus the activities were judged to be appro- 
priate for teachers, and, after minor revisions based on the results 
of the tryout, they were included in the inservlce program. 

Most of the other parts of the inservlce workshop described in 
the previous chapter were tried out In a one-day workshop for exper^ 
ienced DOT teachers. Informal feedback from the teachers at that 
workshop resulted in a reaequenelng of the presentation on DJff assess- 
ment, but the other parts of the program received favorable responses 
from the teachers. The ortly part of the lnser%^lce workshop that was 
not tried out with teachers in advance, was the film. 



51 



The othar main component of the inservlce program^ the inser^ 
vice meetings 3 has been used by the developers of in various 

forms for several years. These meetings have usually been rather 
informal sessions where the writer of the materials provided teach^ 
era with whatever help and encouragement they needed, and where the 
teachers provided the writer with feedback on how the materials 
should be revised, EKperienced DOT teachera were Interviewed about 
the value of these iniervicer meetings. These teachers stated that 
regular inservlce meetings were very useful In helping teachers to 
make appropriate use of the materials. The teachers emphasised that 
DMP and its activity approach are so different from the usual mathe= 
matics program that teachers need time, help, and reassurance as 
they change their teaching practices. The information obtained from 
the experienced DOT teachers emphasized the Importance of the ln= 
service meetings discussed in the previous chapter* 

in summaryj the tryouts of the various companents of the in-- 
service program generally indicated that each component was appro^ 
prlate for helping teachers implement an/ activity approach to learn- 
ing mathematics* On . the basis of the tryouts some minor revisions 
were made in a few of the presentations and materials used in the 
inservlce program. However, no revisions in the basic design of 
the Inservice program appeared to be necessary and the design de^ 
ecribed in Chapter 3 was carried out in the main study. 
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The Tryout of the Evaluation Procediires i 

The evaluation procedurei Included observations ^ questionnaires 
and interviews. The interviews were to be very brief and Infonnalj 
and since they were to 'be carried out by experienced interviewers 
from the field test staffs no pilot testing was necessary. The 
questionnaires were tried out with experienced Dtff teachers from 
both multlunlt and tEaditlonally organised schools. The responses 
on the queatlonnaires and conversations with teachers indicated that 
some items were not clear ^ so the queitionnalrei were revised twice 
before being uied in the main study. But the most extensive of the 
tryouts involved the observation schedule and the observation pro- 
cedures. 

The observation schedule was initially tried out with eight 
experienced DOT teachers. The tryout was conducted by the inves^ 
tigator and two associates who became the observers for both the 
pilot study and the main -^itudy. During the tryout ^ the two obser^ 
vers and the investigator refined the obBervation schedule and 
eliminated as many of the Mblguities and disagreements as possible. 
These disagreements inevitably arise whenever one attempts to de- 
scribe something as complex as teaching , and they raise the problem 
of the reliability of procedures for measuring teacher behavior. 

Many different techniques have been proposed for estimating the 
reliability of observation procedures (McGaWs Wardrops & Bundaj 1972) 
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The first consideration, and the most important one for the present 
study J is the percentage of Inter-^observer agreement. More compll-- 
cated tachnlques for estimating reliability using analysis of vari^ 
ance procedures have been proposed ^ but there is no agreement on 
their applicability in studies of teacher^ behavior where the aasump=- 
tions of the analysis of variance model have not been met (Clauis 
1969), Therefores intern-observer agreement was the meana chosen to 
measure the reliability of the observations. 

Inter-obaerver asreement . After the initial development of the 
observation schedule ^ a pretest of Inter-observer agreement was con- 
ducted before any data were collected for the main study* The per- 
centage of Inter-^observer agreement was based on the last 20 items 
in the Observation Schedule (Appendix B); these 20 Items involved 
some iMiount of observer judgment* Data for the pretest came from 
23 observations where the tw observers gathered data simultaneously 
on each of the eight experienced DOT teachersi the observers agreed 
on 416 items out of 460 for a percentage agreement of 90, 4X. The 
posttept was conducted during the last round of observations at one 
of the schools Involved In the study, and included three observation 
(60 items). The Inter^observer agreement for the posttest was 91*7% 
(Table 1). 

The level of agreement between the two observers compares favor 
ably with that found in other studies of teacher behavior. The high 
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TABLE 1 
INTER^OBSIRVER AGREEMENT 



Assess- 
mant 


Number of 
teachers 


Number of 
observatlona 


Number of 
agreements 


Total number 
of items 


Percent 
agreement 


Pretest 


8 


23 


416 


460 


90.4% 


Posttest 


3 


3 


55 


60 


91.7% 



percentage of agreement resulted from the fact that most of the items 
on the observation schedule focus on specific behaviors that can be 
easily identified. The disagreements betwien judges that did occur 
tended to come from those Items which are labeled In the schedule as 
"high-inference" (Resanshine & Furst , 1971) . For these Items the ■ 
observer had to make a judgment about a series of events rather than 
about one specific behavior. In item III.4, for Bxample, the obser- 
ver had to judge the clarity of the teacher's presentation. While 
It Is difficult to make these hlgh-infereiice judgments reliably, 
they are Important criteria of teacher effectiveness and. deserve to 
be included In studies of teacher performance. 

Data on the performance of successful Dig teachers . As a part 
of the pilot study of the evaluation procedures, complete data were 
gathered on the performance of three of the experienced DMP teachers. 
These three teachers were chosen for several raasons. First, the 
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devalopeTs of DOT^ who were well acquainted with these teacherij 
generally agreed that each of them implemented an activity approach 
in at least a minimally adequate way* Second^ since the three teach- 
ers varied greatly in their teaching style, they provided an oppor^ 
tunity to test the ability of the evaluation procedures to distln'- 
guish between teachers who used different teaching techniques. 
Third j the teachers represented both kindergarten and first-grade 
levels. Since the three succeiiful D>ff teachers were well-known by 
the developers of DOTj data gathered on the performance of those 
teachers could be compared with previous knowledge of their perform- 
ancej thus providing a useful check on the vaildity of the evalua- 
tion procedures* ' 

Each of the three teachers was observed from seven to thirteen 
times; the observations occurred on three to five different days- 
The observation procedures followed in the pilot study were the same 
as those in the main study—the observers spent the first few days 
gathering information on student reaction to the materials and later 
began recording their observations on teacher behavior* Later in 
the semester J after the observations were completed , the teachers 
filled out Questionnaire A, 

The teachers In the pilot study were asiigned mastery , non- 
mastery, or inconclusive ratings, as outlined in Chapter 3# All 
three of the teachers received mastery ratlnge on seventeen of the 
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objectives. Data on the other seven objectives are suimnarized 
Table 2. 

Objective 6, which deals with how the teacher closes an ac- 
tivity, waa the only objective on which a teacher was assigned an 

TABLE 2 , 

RATINGS OF PILOT STUDY TEACHERS ON SEVEN OBJECTIVES 



Objective* 



6 
9 
l8 
20 

21 
22 
24 



Mastery 



2 
2 
1 
0 

2 
2 
2 



Number of teachers rated 



Non-inastery 



0 
1 
2 

3 

1 

1 

1 



Inconclusive 



1 
0 

0 
0 
0 
0 
0 



* These numbers refer to objectives in Appendix A. 



inconclusive rating. During the three days of observations on this 

\ 

\ teacher, no situation arose in which this particular behavior would 
have been expeeted or raqulred* Thus It could not be determined 
whether this teacher did or did not aKhlbit this behavior on occa- 
ntniiN wlii'ii II w^ifj npjM (ipr lnt is 

, Two oj the toadiyrM were very skilled hL probing HLudenL reg- 
ponsea (Objective 9)i and they ancouraged students at every oppor- 
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tunity to validate or Justify their mathematical statements. The 
other teacher demonstrated this behavior during only about half of 
the obseryations, and thus received a non^mastery rating. 

Objectives 18 and 20^ which deal with keeping records of stu- 
dent achievement and using those records to group students for in^ 
structlon on the basis of achievement ^ were generally not achieved 
by the three teachers considered here* These teachers did not attempt 
to individualize Instruction by forming groups of students who needed 
to work on the same topics (Objective 20); as a result they had less 
need for detailed records of student achievement (Objective 18) ^ and 
only one teacher kept such records • 

One teacher did not appear to know that each activity in the DVT 
Teacher's Guide was designed to teach specific objectives (Objective 

21) ; another teacher asked children to sit and wait rather than re"- 
directing them to a new task when they finished, an activity (Objective 

22) , While all of the teachers selected activities in an appropriate 
sequence^ one of them could not identify the various options that DOT 
teachers are encouraged to exercise in choosing and sequencing activ= 
itles (Objective 24). ' 

' Of the 24 objectives, one teacher demonstrated 23, another 21, 
and the third 18 of the desired behaviors. These results indicated 
that the evaluation procedures enabled the observers (who had not 
known these teachers previously) to make judgment s about the teachers- 
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performance that conformed to the opinions of the developers of DI^^ 
who had been associated with these teachers for over a year. While 
each teacher was implementing an activity approach in an adequate 
way 5 the differencei among the teachers were identified by the eval- 
nation procedures , and the correspondence between the evaiuatlon 
results and the opinions of DOT developers provided a useful , though 
informal, check of the validity of the assessment- 

The data on the three successful DMP teachers indicated that 
the mastery level of 75% (i.e,, assigning a mastery rating to a 
teacher who demonstrated the desired behavior in 75% of the obeer^ 
vations where it was appropriate) was useful for differentiating 
among teachers. Also, the pilot study showed that a teacher could 
be rated mastery or non=maatery on almost every objective by the end 
of seven observations* an inconclusive rating was used only once. 
Reducing the number of observations of these teachers to four or five 
would have had no effect on the ratings for most objectlvesi however, 
for those objectives (4, 6, and 22) which were frequently not obser- 
vable during the pilot study, a reduction in the number of observa- 
tions would have resulted in an increased number of inconclusive : 
ratings* But since Objectives 4, 6, and 22 are not the most Impor- 
tant of the objectives^ and since gathering seven or more obaerva- 
,tions' on each teacher would have invplved extra costs in money and 
time disproportionate to the information gained, it seemed reason- 
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able to obtain four or five observations on each teacher and to 
expect a somewhat higher occurrence of. Inconclusive ratings in the 
main study. 

On the basis of the observations made in the pilot study it 
appeared that a teacher should be observed on at least three dif= 
ferent days before a rating of mastery could be assigned. This 
was a mafctar of judgment based on the experience gained during the 
pilot studyi a sample of only one or two days of observations seemed 
too small for assessing teacher behavior. The variety of tasks and 
Instructional procedures used in an activity approach make It par-- 
tlcularly important that observations be carried out on more than 
two days so that a sufficient saniple of the various procedures can 
be obieryed, , 

The pilot study of the eight experienced Dtff teachers was very 
useful in verifying that the evaluation procedures outlined In the 
previous chapter could be applied reliably. In addition, the data 
collected on the three successful DMP teachers in the pilot study 
helped to establish the validity of the data gathered in the main 
study. Therefore, the. evaluation procedures were applied in the 
main study according to the plans of the dfesign. Besides verifying 
the applicability of the evaluation procedures, the experience gained 
in the pilot study made it possible to set realistic criteria for 
judging the success of the inservice program and for determining 
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whether or not a teacher had implemented DOT' s activity approach to 
learning mathematici in at least a minimally adequate way. The next 
section of the paper will discuss those critefia/ 
The Performance Criteria 

One of the purposea of the pilot study of the evaluation pro-^ 
cedurei was to gather baie-llne data on what constituted satis= 
factory achievement of the objectives of the inservice program. The 
data on the successful BW teachers, along with tj^^ goals of the 
developers of dm, were used in setting desired performance levels 
or performance criteria for the teachers in the main study. In order 
to determine the effectiveness of the inservice program, the teach-^ 
era' performance would be compared to these criteria^ not to a con- 
trol group> and judgments about the Iniervlce program would be based 
on that comparison, 

The performance criteria were determined in relation to the 
first two questions of the study, as stated in Chapter 1. The first 
question asked for the proportion of the teachers that would achieve 
each objective of the inservice program. For the inservice program 
to be judged a success, it was determined that 90% of the teachers 
should teach toward the objectives for D^ff stucl'ints (Ob Jective 1) , 
provide the printed and manipulative materials needed Cor the activ= 
ities (Objective 2), and demonscrate their own maetery of the objec>- 
tlves for DMP students (Objective 16), These three objectives are 
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the most crucial, and they will be referred to as Category A objac^ 
tivaa (Table 3) . ' 

Since Category A objectives are so basic to a teacher's imple^ 
mentation of an activity approach to learning mathematics, they 
were assigned the criterion level of 90%. Every objective not in 
Category A was aislgned the criterion level of 80%, Objectives not 
In Category A were still considered to be important, but they were 
judged to be less crucial to an activity approach than the Category 
A objectives* In suiranary, a completely successful inservice program 
would result in 90% of the teachers in the study receiving mastery 
ratings on each of Objectives 1^ 2, and 16 (Category A), and 80%. . 
of the teachers achieving mastery of each objective not in Category 
A (Table 4)* ' 

The second question stated in Chapter 1 asked for the proportion 
of the teachers in the study that would Implement an activity ap- 
proach to learning mathematics. Before this question can be an=- 
sweredj it is first necessary to state the criteria for Judging 
whether a teacher's performance represents adequate implementation 
of an activity approach. The most Important objectives in making 
this Judgment are again those in pategory A; a teacher should achieve 
all three of the objectives in Category A in order for that teacher's 
performance to be considered satisfactory* In addition, a teacher 
who implements an activity approach should achieve the objectives in 
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TABLE 3 





OBJECTIVES IN CATEGORIES A AND B 


Category 


Objective 


Abbreviated statement of obiectivp 






1 


teaches toward D^P student objectives 


A 


2 . 


provides printed and manipulative 
materiala 




16 


demonstrates mastery of DOT student 
objectives 




3 


focuses on the problem or objective 
of the activity 



asks for validation of statements 

questions rather than lac turas 

usee small groups , pairs, etc, as 
recommended 

describes mathematical processes 

groups students according to assess^ 
ment information 



TABLE 4 

PERFORMANCE CRITERIA FOR JUDGING THE INSERVICE PROGRAM 



Objectives for teachers 


Criterion level 


Objectives 1, 2, and 16 


90% 


(Category A) 




Objectives not in Category A 


80% 



9 

10 
11 

17 

20 
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Category B (mie 3) | that li, the teacher should focus on the prob 
lem or objective of the activity (Objective 3), ask for validation 
(Objective 9), question rather than lecture (Objective 10), use 
small groups or pairs as recommended (Objective 11), describe the 
mathematical processes emphasized by DOT (Objective 17), and group 
students according to the assessment information (Objective 20). 
However, on the basis of data from the pilot studies and judgments 
by the developers of DOT, it seemed that teachers could do an ade- 
quate Job of implementing an activity approach to learning mathe- 
matics by achieving only five out of the six objectives in Category 
B. Therefore, achieving mastery of all Category A objectives and 
all but one of the Category B objectives was considered satisfactory 
performance by DOT teachers. 

One variation in this set of criteria was made for teachers who 
were not in multlunlt schools. Objective 20 is much easier to 
achieve in multiunlt schools where the organizational arrangements 
provide the flexibility needed for grouping students on the basis of 
achievement. Therefore. Objective 20 was not considered when judging 
a teacher from a non-multlunit school on objectives in Category B. 
Table 5 presents a summary of the performance criteria used in de- 
ciding whether a teacher's implemsntatlon of DOT' s activity approach 
was adequate. Of course, objectives that were not included in 
Categorias A and B were still desired outcomes of the inservice 
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programs even though they were not part of the criteria used in 
aniwerlng Question 2- - 

TABLE 5 

PERFORMMCE CRITERIA FOR IMPLEMENTING AN 



ACTIVITY M^PROACH TO LEARNING MATHEMTICS 


Teachers 


Performance criteria 


Multlunit 


All objectives in Category A^ 

Five out of six bbjectlves in Category 


Non-mult iunit 


, All objectives in Category A 
Four out of five objectives in Category 
not including Objective 20 





Categories A and B are defined in Table 3. 



The performance criteria dlscusaed in this section were uaed in 
making judgments about the effectiveness of the inservice program^ 
and are referred to again in Chapter 6 along with the data from the 
main study. Before presenting that dataj however ^ the neKt chapter 
will discuis the conduct of the study. 



Chapter 5 
THE CONDUCT OF TIffi STUDY 



The pilot studias reported in the previous chapter provided 
some evidence of the appropriateness of the inservice program and 
the evaluation procedures, the two main elements of the design of 
the study. Therefore, the study was conducted according to the 
original plans as discussed in the design reported in Chapter 3. 
However, because of the needs of the particular schools and teach- 
ers that participated in the study, there were some variations in 
the Inservice program. These variations will be reported in this 
chapter, along with a description of the participants in the study 
and the details of the application of the evaluation procedures. 
Participa ting Schools and TeacherB 

As Indicated in Chapter 3, the study was conducted in conjunc- 
tion with the field test of the kindergarten and first-grade levels 
of DMP. Eight schools were chosen to participate in the field test— 
four multiunit schools from rural and suburban areas of Wisconsin 
and four Inner-clty schools from Milwaukee and Chicago. Schools with 
widely varying characteristics were chosen so that the DJff field test 
would include students with markedly different backgrounds. 
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■The multlunlt schools. These schools all followed a multlunlt 
organizational pattern slndlar to that in Figure 1; students In the 
school were divided up into units of 50 to 150 children, and each 
unit was taught by a team of 'two to six teachers. Two of the schooli 
had kindergarten units that were separate from the first-grade stu- 
dents, and in the other two schools kindergarcens appeared to oper- 
ate fairly autonoraousiy within the unit; this seems to be a natural 
situation caused primarily by the fact that kindergartners attend 
school only half-days. Except for this special independence of the 
kindergarten teachers, the teams tended to operate according to the 
reconiinended practices for the multlunit school. (See Klausineler , 
Quilling, Sorenson, Way, & Glasrud, 1971, for a complete descrip- 
tion of the operation of multlunit schools.) 

All of the inultlunit schools had had previous contact with the 
Wisconsin Research and Development Center, but none of them had been 
involved with DMP. Three of the four had been in operation as multi- 
unit schools for one year or more be.!ore the start of the field test; 
the fourth was new to the multlunit organization. All of these 
schools had had special training programs in multlunit operations, 
including particularly the use of behavioral obj actives and assess- 
ment procedures for grouping students on the basis of achievement. 
In these schools teachers did not always work with the same group 
of students, nor ware they always in the same classroom. 

The students in the multlunit schools came mostly from white 



67 



middle-class homes in small towns or suburban-like areas of larger 
cities. 

The inner-clt^chools. In contrast to the multlunlt schools, 
all of the inner-city schools were organized into self-contained 
classrooms, where teachers worked with the same students throughout 
the year rather than sharing the teaching responsibilities as mem- 
bers of a team. None of thesie schools had had any previous contact 
with the Center. 

In three of the schools, almost all of the students were black, 
while the fourth had a substantial number of Spanish-speaking stu- 
dents along with members of several other ethnic groups. Each school 
had an integrated faculty. The neighborhoods served by the schools 
were generally of low socioeconomic status. 

Teashers. At the beginning of the school year there were 40 
women in the eight schools who were teaching at the level of kinder= 
garten or first grade i all of these teachers agreed to participate 
in the field test. Of these teachers, 21 taught in multlunlt schools, 
and 19 in inner-city schools. During the study, two first-grade 
teachers left their positions, one from each type of school- this 
left 38 teachers as- participants in the study (see Table 6), a mor- 
tality rate for the experiment of only SX, 

AH of the teachers in the study had at iQast a Bachelor's de- 
gree, and three of them had completed their Master's. Some received 
their degrees as early as the 1930's. while others were 1971 graduates.' 
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TABLE 6 
PARTICIPATING TEACHERS 



Description 


Multiunlt School 


Inner^city 
School 


Total 


All K^l teachers 


21 


19 


40 


Teachers who changed 
employment during 
study 


1 


1 


2 


Teachers included 
in the study 


20 


18 


38 



The teachers varied widely in ag^ and in years of teaching ex^ 
perience* Ages ranged from the early 20' s to over 60^ with a mean 
of about 40; some teachers had over 30 years of experience, while 
for others s this was the first year of teaching. The mean number of 
years of experience ^ ^lounting the year of the study, was 14 , and 
for the teachers with eKperiencej most of them had taught at their 
current grade level for the major part of the past five years. 

From this description of the teachers, it appears that they are 
not unusual in their educational background, age, or years of exper- 
ience * In facts they seem to be quite similar on these character- 
istics to the teachers studied by Goodladj Klein, and Associates 
(1970) in their investigation of teacher practices, Relationahips 
between teacher performance and these (and other) teacher charac^ 
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terlstlas will be reported in Chapter 6* 
The Conduct of the Inservlce Program 

The Inservice program was generally carried out according to 
the ipeclf Ications of the designs but there were some variations. 
In five of the eight schools ^ the variations were minor , consisting 
only of slight changes dua to scheduling problems; for eKaraple, in 
some of these schools the two=day workshop could not be held on 
sueceasive days. In the other three schools ^ however, all located 
in the inner city, only a one-day workshop was possible* The one- 
day workshop Included a condensed version of all the agenda Items, 
except for the film, which was omitted. 

The brevity of the one^day workshop was compensated for in two 
ways. Firsts a staff member was assigned to give individual help 
to teachers in the three inner-city schools that received only a one-- 
day workshop. The staff member spent from two to four hours consult- 
ing with each teacher during the first half of the semester. Second ^ 
the schedule of Inservlce meetings in these schools was extended to 
Include two extra meetings. One of these meetings presented a video- 
tape of an eKperienced Dtff teacher conducting an activity | the video-- 
tape and the discussion of It covered the same topics as the film 
shown at the other workshops. In the other Inservlce meeting, the 
mathematical content of DOTj particularly the geometry ^ was dis- 
cussed in an* attempt to compensate for the brief treatment the 
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subject received in the one^day meeting. 

Juit as Individual help was given to^ teachers who attended the 
workshop that lasted only one day, teachers who did not attend a 
workshop at all were provided with extra conaulatlon time by a staff 
member. Of the seven teachers who were absent from their workshop, 
all but one taught in the same three Inner-^city schools that had had 
the one-day. workshop (Table 7), so these teachers were already re^ 
celving compensatory training. Teachers who missed an Inservice 
meeting were also given extra help. This was not a major part of 
anyone's training, however 5 since no teacher missed mora than one 
of the four main inaervlce meetings, 

TABLE 7 ■ 





ATTENDANCE AT THE 


SUMIER WORKSHOP 




Teachers 


Number Absent 


Number Pres?ent 


Total 


Multlunlt 


1 


19 


20 


Inner- city 


6 


12 


18 


Total 


7 


31 


38 



Most of the teachers participated in the field test quite wlll« 
Ingly, but some teachers indicated during the Inservice meetings that 
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they had not wiahed to become involved. There were two groups of 
teachers who expressed these reaervations. One group included 
eight of the thirteen kindergarten teachers; these eight teachers 
had become accustomed to teaching "their own" mathematlcB prograins— 
programs which they had designed to teach their children the mathe- 
matics that they believed to be iraportant, usually counting and 
writing numerals. These kindergarten teachers were naturally a bit 
reluctant at first to give up programs of their own design in order 
to implement , particularly since DJff begins by studying pro- 
cesses that are important in solving mathematical problems, rather 
than with counting and writing nun;erals. However, all of these 
teachers participated actively in the Inservlce program, and even 
though they were somewhat skeptical initially, they were willing to 
give Bm materials a fair try in the classroom. 

The other group who expressed some reservations about partici- 
pating in the field test included all six teachers from one of the 
inner-city schools. These teachers Indicated that the school ad- 
ministration had given them little choice in the decision to partici- 
pate in the field test, and some of them were reluctant to use Dlff 
and Its activity approach to learning mathematics. One teacher ex- 
pressed a fear of being sued if she let children use manipulative 
maCerlais and they hurt themselves.. And in her view, reading was 
more important than mathematics, so she preferr^ed to spend her time 
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on language developinent. However, most of the teachers in this 
Inner-city school, in spite of their reservations, participated 
willingly in the inaervice meetings, and by the end of the in- 
service training period, all but two of them were using DOT 
naterials regularly in their classrooms. The change in the views 
of these six teachers was reflected in their attendance at Inser- 
vice meetings; while four of them did not attend the Inital in- 
service workshop, ail of them were present for the mid-year work- 
shop in January, 

Both of the groups of teachers who had reservations about 
implementlnR um and its activity approach to lenrnlng mathematics 
became much more positive in their outlook by the end of the inser 
vice program. One of the main factors in this change of outlook, 
in addition to the inaervice program itself, appeared to be the 
favorable reaction of students to the program. During the inser- 
vice meetings teachers reported that the children did not want to 
Btop "math class" and that they would "usually pick math" if they 
were given an opportunity to choose something to work on during 
free time. These favorable reports appeared to encourage the teach 
ers who had initially been somewhat reluctant to implement DOT. 

Ill summary, the cdnduct of the Inservice program generally 
followed the design presented in Chapter 3| the differences between 
the design and the conduct of the inservice prograra resulted mostly 
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from the problem of scheduling the Inieirvice workshop in three 
lnner=clty schools. The teachers generally reacted favorably to 
both ^the workshop and the Inservlce meetings* Eighty-'three per^ 
cent of the teachers who responded on Questionnaire C indicated 
that they had found the workshop to be a useful experience, and 
85% of the teachers gave the inservlce meetings a positive evalua= 
tion* It was also the opinion of the observers that the inservlce 
meatinga were successful in providing encouragement and support 
for the teachers as well as information that would help them imple^ 
ment DMP and its activity approach to learning mathematics* 

As the inservice program ended ^ the evaluation procedures were 
begun. The next section of the report describea the application 
of the procedures deaigned to evaluate the effectiveness of the 
Inservice program. 

The Application of ,.the Evaluation Procedures 

The evaluation procedures were carried out accordirg to the 
specifications of the design* Data were gathered by observation 
and questlt^nnalre on all 38 teachers, and interviews were conducted 
with 21 teachers who were randomly sampled from each grade level* 
The observations .were carried out by the same two observers 
who participated .in the pilot study of the evaluation procedures* 
Both of the observers were experienced teachers of secondary school 
mathematics, both had Master degrees, and both were graduate stu- 
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dents at the t iins of th© s tudy • Ths obssrvsry conduc ted ths iti'" 
service meetings ^ and alio assisted in the workshops. They were 
vary familiar with the materials that the teachers were using in 
the field test. For a record of the observers' actiyitiea, see 
AppendiK E, 

The observers saw 27 of the 38 teachers on all four obser^ 
vatlon daySs ^nd nine more of the teachers were observed on three 
days* The other two teachers were observed on fewer than three 
daySj so they could receive only non-mastery or inconclusive ratings 
on the objectives that were assessed by observation. The mean ninnber 
of observationn per teacher was S.Oj with a range -from one to eight 
observations per teacher. Two teachers were observed fewer than 
three times ^ two others were observed exactly three times, and the 
remaining 34 teachers were observed on four or more occaBions. No 
teacher was observed more than three times on a single day* 

The inser/ice and evaluation work was shared about equally be^ 
tween the two observers (X and Y) , although one observer (Y) did have 
tc leave the study halfway through the fourth and final round of ob= 
servationa. Of the 38 teachers in the study, all but two were seen 
by both observers. These two teachers were absent or unavailable on 
the occasions when Observer Y was In their schools, Suimnary data on 
the activities of the observers are found in Table 8, 

In addition to the pretest and posttest t.f inter-observer agree^ 
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TABLE 8 





SUfmARY OF OBSERVERS' 


ACTIVITIES 




Observer 


Number of 
Observations 


Mean Number of 
Observations ner Tearhpr 


X 


101 




2.66 


Y 


89 




2.34 


Total 


190 




5.00 



ment reported in Chapter 4, further analyses of the observational 
data were undertaken in order to gain more information on the re^ 
liability of the observations* Some differenceiJ were found between 
the obsefvers in the nmnber of times during an observation that they 
judged the teacher's performance to be unsatisfactory (Table 9). 
While it was usually the case that not every behavior could be judged 
in a single five-minute observation, the obseryer generally made 
15 to 20 judgments per observation as he determined whether teacher 
performance was satisfactory or unsatisfactory on the objectives that 
were appropriate at that time. Of these 15 to ?n judgments per ob^ 
servation, Observer K averaged 1*1 judgments of unsatisfactory per-- 
formance, compared to 0.6 for Observer These differences could 
have resulted from a number of factors. For example^ the activities 
Q vary considerably In how difficult they are to teach, and the obatr- 

ERIC j 
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vers did not always see the same activities, Also^ the two teachers 
whose frequent absences prevented Observer Y from seeing them were 
a rich source of unsatisfactory performance for Observer X. Ellmina^ 
ting these two teachers would reduce the ratio for Observer X to 
I.O while leaving Observer Y-s ratio unchanged* These types of 
variations in what was observed may account for the differences be^ 
tween observers, or these di££^?rences could have resulted from a 
Iflck of agreement between judges on what conBtituted unsatisfactory 
performance i 

TABLE 9 

DIFFERENCES BETWEEN OBSERVERS 
IN JUDGMENTS OF UNSATISFACTORY PERFORmNCE 



ERIC 



Observer Number of Number of judgments Ratio of judgments 

wbservatlona of unsatisfactory of unsatisfactory 

performance performance to 

observations 



X 101 110 la 

Y 89 49 0.6 

A re-analysis of the data from the pretest and posttest of 
InLer-observer agreement indicated that no differences in the number 
of judgments of Inadequacy existed on either test. However , in 
view of the possibility that differences developed between the ob-- 

1 

servers during the study on what constitutes unsatisfactory per^ 
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formancej it would be important for the observers to have seen 
each teacher about the saine numbar of times. Data indleating the 
distribution of the differences between the observers on the number 
of times that they saw each teacher is presented in Table 10. For 
34 out of the ij8 teachers, the difference between the number of 

TABLE 10 

DIFFERENCES BETWEEN OBSERVERS IN NUMBER OF 
OBSERVATIONS OF A TEACHER 



The number of teachers who were observed: 

The same number of times by each observer 9 

Once more by one observer than the other X3 

Twice more by one observer than the other 12 

Three times more by one observer than the other 3 

Four times more by one observer than the other 1 



Total Number of Teachers 



38 



times that the teacher was observed by X and the number of times she 
was observed by Y was no more than two. Therefore, even If there 
were slight differences between the observers on judging unsatis- 
factory performance, and the tests of inter-observer agreement indi- 
cate that there were not, these differences would have been dis- 
tributed fairly fvenly over the teachers in the HHidy. TIiuh ,-iny 
differences that might have existed between uhHurvaru Mhoiilfl hswc 



78 



had no Important effect on the results of the study since these 
results are baled on pooled data from the two observers* 

In addition to the observations ^ data were also gathered by 
questionnaire- and by Interview, The questionnaires ware adminis^ 
terad during a half-^day workshop; these workshops were held during 
January and February after all the qbservatlons had been completed. 
The main purposes of the mld='year workshop were to gather data from 
the teachers, to discuss with the teachers the results of the field 
test up to that point, and to continue the Inservlcii training In 
areas where the teachers need more help* All the teachers in the 
study attended the mid^year workshop; no one was absent ^ even 
though a snowstorm cut short one workshop and a flu epidemic in 
one school caused another workshop to be postponed* 

The teachers completed Questionnaire A during the workshop. 
Since Questionnaire A Included some Items that assesied the teachers' 
knowledge of the materials , it was emphasized that the teachers 
should respond independently; they generally did, although testing 
condiMons were often less than ideal. Questionnaires B and C, 
which g£:thered Information on the teachers V background and opinions, 
were given to the teach irs, during the mid-year workshop* In order 
to keep the workshop from becoming too long^ the teachers were given 
postage=paid envelopes and told that they could send in Questionnaires 
B and C by mall. All but two teachers returned the questionnaire as 
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requested. 

In addition to gathering data by observation and by question- 
naire, the field test staff interviewed 21 teachers about their 
records of student achlevemerit . These 21 teachers were selected 
randomly from within each grade level, and the Interviews were 
conducted according to the procedures outlined in Chapter 3. 

In suimnary, the application of the evaluation procedures- 
observations, questionnaires, and intervlews~f oUowed the 
specifications of the design of the study. The results of the 
evaluation of the effectiveness of the inservlce program are re- 
ported in the next chapter. 



Chapter 6 
RESULTS 
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In order to evaluata the ef f ectivenesa of the inservice pr^- 
gramj data were gathered on the performance of . all 38 teachers in\ 
the study. Following the procedures deicrlbed in Chapter 3, each 
teacher waa given a mastery, non-mastery, or ineonclualva rating 
on each of the 24 objectlvas listed in Appendix A. This chapter 
reports first the ratings on each objective for both the 20 multi-- 
unit teachers and for the 18 inner^city teachera by grade level; 
thus the first section of this chapter presents a suirarary of the 
data on teacher performance for these four groups of teachers. 
Since there are only, six kindergarten teachers in multiunit schools 
and only seven in inner-city achools, the cell sizes are too small 
to provide meaningful anawers to the three main questions of this 
study, as 'stated in Chapter 1. Therefore, the data are further 
analyzed and presented again in the later sections of this chapter 
in order to answer the three questioni of the study. 
Summary of Teacher Performance Data 

As indicated in Table 11, almost all of the teachers in the 
study chose to do activities that would help students achieve the 
objectives of the program (Objective 1) and to provide the materiale 
needed for the activities (Objective^ 2) . Only three of the first- 
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TABLE 11 



MTINGS OF MULTIUNIT AND INNER-CITY 
TEACHERS BY GMDE LEVEL ON OBJECTIVES 1-^2 



Grade Multlunlt Teachers Inner-city Teachers 

Maitery Non*- Incon= Mastery Non- Incon- 
mastery elusive mastery elusive 

ective 1 



K 6 0 0 7 0 0 

1 14 0 0 8 2 1 



Objective 2 

K 6 0 0 7 0 0 

1 14 . 0 0 9 1 1 
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grada^ Inner-city teachers did not receive mastery ratings on both 
of these objectives* two of these thrae teachers were observed on 
fewer than three days, and accprding to the procedures established 
for the study, were aasigned only non=-mastery or inconclusive rat- 
ings* Therefore » these two first-grade, inner^clty teachers will 
always be included in the non^mastery or Inconclusive categories 
for objectives assessed prlinarlly by observation (Objectivea 1-16 
and 22)* 

Table 12 presents the data on the objectives relatad to the 
teachers' structuring cdnunents. Most teachers did focua the activ^ 
ity on a problem or an objective (Objective 3) and eKplained the 
activity clearly (Objective 5)* However, the teachers did not do 
as well on relating the activity to earlier work (Oblective 4) or on 
closing the activity with a discussion of what the children had 
learned (Objective 6)* While kindergarten teachers received fewer 
inconclusive ratings on Objective 6, this appeared to be due in part 
to the fact that they had been observed an average of six times each 
while the mean number of observations of first grade teachers was 
less than five. 

The d'ita on objectives related to teaeher-studant interaction 
are presented in Table 13* Multiunit teachers did a better job of 
using student ideas (Objective 7) and they criticized student contri- 
butions leas frequently (Objective 8) than did inner^city teachers.' 
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TABLE 12 



RATINGS OF MULTIUNIT AND INNER--CITY 
TEACHERS BY GRADE LEVEL ON OBjECTIVES 3-6 



Grade Multlunlt Teachers Inner^clty Teachers 

Mastery Non* Incon-^ Mastery Non-^ Incon= 
Tnagtary elusive mastery elusive 

Objective 3 

K 6 0 0 7 0 0 

1 14 0 0 9 0 2 



Obiective 4 

K 2 4 0 3 13 

1 8 0 6 5 3 3 

Objective 5 - 

K 6 0 0 7.0 0 

1 13 1 0 8 12 

Objective 6 

K 5 0 1 5 0 2 

1 5 0 9 4 0 7 
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TABLE 13 



RATINGS OF MULTIUNIT AND INNER-CITY 
TEACHERS BY GRADE LEVEL ON OBJECTIVES 7-10 



Grade Multlunit Teachers Inner-city Teachers 



Mastery ' Non- Incon- Mastery Non- Incon- 

- mastery elusive mastery elusive 

Obieetlve 7 

K 6 0 0 5 2 0 

1 13 1 0 7 3 1 

Ob.lectlve 8 

K 6 0 0 6 1 0 

1 14 0 0 7 3 1 

Objective 9 

K 5 1 0 , 4 3 0 

1 9 5 0 6 5 0 

- Obieetlve 10 

K 6 0 0 7 0 0 

1 13 1 0 9 0 2 
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While these dlfferencea do not involve a large number of teachers, 
the ratings Indicate soma ways in which the two types of schools 
differ. Many teachers in both kinds of schools did not use probing 
questions (Objectiva 9)j only kindergarten teachars in multiunit 
Bchools achieved this objective fairly consistently. However ^ al= 
most all teachers chose to use questioning and discussion techniques 
as opposed to lecturing (Objective 10)* 

Most teachers organised their classrooms appropriately for an 
activity approach. They had children work in small groups when 
appropriate (Objective 11), and they movad from group to groups act- 
ing as a resourcfe pGrson (Objective 12), The data for these two 
object Ivas are suimiarized in T^ble 14, In addition the teachers 
usually allowed children to move purposefully about the room (Objec- 
tive 13) and to interact with other children while working on activ- 
ities (Objective 14), Teachers also arranged their rooms appro- 
priately for an activity approach (Objective 15) • Table 15 includes 
the data on Objectives IS^-IS. 

As Table 16 Indicates ^ the teachers had no difficulty in master- 
ing the mathematical objectives of their students (ObjeetivG 16), 
However, teachers did have some difficulty in describing the mathe- 
iflatical processes emphasiEed by the materials they were using (Ob- 
jective 17), Again, kindergarten teachers in multiunit schools did 
somewhat better than the other teachers (Tabie 16)* 
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TABLE 14 



RATINGS OF MULTIUNIT AND INNER-CITY 
TEACHERS BY GMDE LEVEL ON OBJECTIVES 11-12 



Grade Multlunit Teachers Inner--city Teachers 



Mastery Ndn- Incon- Mastery Ngn- Incon- 

maatery elusive mastery cluelva 

Objective 11 ^ 

K 6 0 0 7 0 0 

1 14 0 0 9 1 1 

Oblectlve 12 

K 6 0 0 7 ,0 0 

1 14 0 0 9 0 2 
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TABLE 15 



RATINGS OF MULTIUNIT AND INNER-CITY 
TEACHERS BY GRADE LEVEL ON OBJECTIVES 13-15 



Grade 


Mult: 
Majtery 


Lunlt Teaohars 
Non- Incon- 
mastery elusive 


Inner- 
Mastary 


-city Teachers 

Non- Incon- 
masterv nliiaii/o 


Oblectlve 13 


K 


6 


0 


0 


7 


0 


0 


1 


14 


0 


0 


9 


0 


2 








Ob-jectlve 14 








K 


6 


0 


0 


7 


0 


0 


1 


14 


0 


0 


9 


. 1 


1 








Oblectlve 15 








K 


6 , 


0 


0 


7 


0 


0 


1 


14 


0 


0 


9 


1 


1 
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TABLE 16 



RATINGS OF MULTIUNIT AND INNER-CITY 
TEACHERS BY GRADE LEVEL ON OBJECTIVES 16-^17 



Grade Multtunlt Teachers Inner-city Teachers 

Mastery Non- Incon-- Mastery ^ Non= Incon- 
m astary cluglve mastery elusive 

Objective 16 ^ 



K 6 0 0 7 0 0 

1 1^ 0 0 8 0 3 



Objective 17 

K .5 1 0 3 4 0 

1 7 7 0 7 3 1 
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The remaining objactives deal with managini instruction in order 
to provide for individual differances* Since teachers in multiunlt 
schools have extra background and es^erience In this area^ It is not 
surprielng that they usually did somewhat bettar than inner-city 
teachers on Objectives 18-24. As Table 17 Indicates ^ first-gride 
teachers In inner-city schools often did not assess students and keep 
records of student achlevmment (Objective 18) j and most innar-clty 
teachers could not adequately describe the purppses of the various 
assessment inatrmnents (Objectiva 19)/ First-grade teachers in multi- 
unit schools generally grouped students according to achievemant 
(Objective 20), and only kindergarten teachers in multiunlt schools 
appeared to be aware of the. relationship between activities and ob- 
jectives In the materials for teachers CObJectlve 21). 

Data On the remaining three objectives related to managing in- 
struction are included In Table 18, Only a few teachers were ob-- 
served when demonstrating mastery of Objective 22 ^ which dealt with 
re-directing students whan they finished an activity. While no group 
of teachers did particularly well on classifying a hypothetical set 
of students into those who had achieved the prerequisite behaviors 
for a topic and those who had not (Objective 23), first-grade teachers 
did slightly better on this objective than kindergarten teachers. On 
Objective 24 multiunlt teachers tended to do better than inner'-clty 
teachers on Identifying the various options" dealing with choosing and 
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TABLE 17 



RATINGS OF MULTIUMIT AND INNER-CITY 
TEACHERS BY GRadE LEVEL ON , OBJECTIVES 18-21 



Grade 


Multiunlt Teachers 
Mastery Non~ Incon- Ma 
mastery elusive 


Inner-city Teacbetfs 
atery Non- Incon- 
masterv' elusive 






Objective 18 








K 


4 


2 0 


6 


0 


1 


1 


12 


0 2 


5 


5 


1 






Objective 19 








K 


4 


2 0 


3 


4 


0 


1 


13 




5 


5 


1 






oyective 20 








K- 


2 


4 0 


4 


3 


0 


1 


12 


2 0 . 


4 


7 . 


0 


objective 21 


K 


4 


2 0 


1 


5 


1 


1 


6 


8 0 


4 


6 


1 
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TABLE 18 



RATINGS OF MULTIUNIT AND INNER-CITY 
TEACHIRS BY GRADE LEVEL ON OBJECTIVES 22-24 



Grade Multlunit Teachers Inner-city Teachers 



Mastery Non- Incon- Mastery Non- Incon- 

mastery elusive mastery elusive 

Objective 22 ^ 

K 2 1 3 115 

1 3 1 10 11 9 

Objective 23 

K 3 3 0 3 4.0 

1 9 5 0 6 5 0 

Objective 24 

K . 5 1 0 3 3 1 

1 11 2 1 3 6 2 
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sequencing the activities that were included In the teachers' ma^ 
terlalSi 

This section of the chapter has presented a summary of the data 
on teacher performance for four groups of teachers-*-klndergarten and 
first grade teachers in multlunit and inner--clty schools. In the 
nsKt section the data will be characterised in terms of the three 
main questions of the study, , These questions were originally stated 
in Chapter 1; they are repeated below for the convenience of the 
reader * 

Question It What proportion of the teachers 
achieve each objective of the 
inservice program? 

Question 2i What proportion of the teachers 

in the stidy implement an activity 
approach to learning mathematifis? 

Question 3 1 What are the charaeteriatics of 

the teachers who fail to implement 
an activity approach in their 
classroom, and are these characteristics 
stollar to or different from the identi- 
fying features of non-adoptars of other 
innovations? 

Data on Question 1 

The effectiveness of the inservice program was measured by 
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determining how many of the teachers achieved the objectives re- 
lated to implementing an- activity approach to learning mathematics 
(AppendlK A). This section of the paper answers Question 1 by ra= 
porting whether the criterion livals set for the inservice program 
were reached. These criterion levels were as follows: 901 of the 
teachers should master Objectives 1, 2, and 16, and 80% should mas= 
ter all other obj actives * 

The results of the study are reported in terms of the number 
Of teachers who received a mastery rating' on each objective. Impor^ 
tant differences between subgroups of the teachers will be noted 
when they occur . 

use of Dm materials; Objenf-xv.. i ... , Almost all of the 
teachers chose to do activities that taught toward DOT student ob- 
jectives (Objective 1) and provided the printed and manipulative 
materials that were needed for the activities (Objective 2). Thus 
the teachers reached the criterion level of 902 on each of these 
Objectives (Table 19). Both objectivas were assessed by observation. 

One teacher received a non-mastery rating on each of these ob- 
Jaetives; she indicated that after more than 30 years of teaching 
and With retirement near, she had no desire to become "active" in 
any "activity approach." She was observed teaching mathematics only 
onaei on the other occasions when an obs.rvar was present, she did 
not teach any mathematics at all. Another teacher received an "in^ 
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TABLE 19 

TEACHER ACHIEVEMENT OF OBJECTIVES 1 AND 2 



Rating Number Percent NumbiT" Pert^ 

^^tery 35 92.1 36 94,7 



Non-mastery 2 5.3 



2.6 



Inconclusive 1 2.6 



2.6 



conclusive" rating on both objectives because she was observed only 
twice due to absences because of illness, and the procedures of the 
study required at least three observations before a mastery rating 
could be assigned. These two teachers will always be included In 
the non-mastery or inconGlualve eatagorles for objectives assessed 
by observation. 

Strueturln B comments ; Ob-| ectlv es 3-6 . The four objectives 
that Involved the teachers' structuring comments were all assessed 
by observation. The results of the observations Indicated that the 
Inaervlce prosram was succesaful In helplna teaohers achieve two of 
theBe objectives. The teachers ware generally able to provide a 
focus for the aotivlcy by identifying a problem for the children Lo 
solve or an objective for them to achieve (objective 3); also, 
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teachers had usually prap„ed well enough so that they could aKplaln 
the activity 1„ a clear and well-organized manner (Objective 5). 
The criterion level pf 80% for these two objectives was surpassed In 
Mch caaa (Table 20)* 

However, the B0% criterion level was not reached on two other 
objectives that deal with the teachera' structuring comments (Table 
21). Only 47% of the teachers related the activity that children 
were working on to what had been done earlier (Objective 4). Some 
teachers tended to present activities in isolation aa though today 
problem about how to identify pictures with line synmetry, for eK= 
ample, was not related to yesterday's work on paper folding. 

TABLE 20 ■ 
TEACHER ACHIEVEbfflNT OF OBJECTIVES 3 AND 5 



's 



" " percent Number Percent 

^^^"^ 36 94.7. 34 89.5 



Non-mastery 0 o.O 



5.3 



Inconclusive 2 53 



5.3 



Also, half of the teachers ware never observed bringing the ehil- 
dren together at the end of an activity to disGuss what they had 
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TABLE 13 

TEACHER ACHIEVEtffiNT OF OBJECTIVES 4 AND 6 





Obi active 4 


Ob1 active 6 


Rating 


Number 


Percent 


Nuinher 


■percent 


Mastery 


18 


47.4 


19 


50.0 


Non-mastery 


8 


21.1 


0 


0.0 


Inconclusive 


12 


31.5 


19 


50.0 


illshadj what 


problems 


they had solved 


(Objective ( 


5), One of 



the reasons that this ©bjeetlve was not achieved more often is that 
mathematics class periods tend to be short p By the time a teacher 
introduces an activity , breaks the class Into imall groupi to work 
on the activity 5 and moves from group to group aeklng and answering 
questions, the claei period ii over and there is no time left to 
discuss with the children what they learned. Short class periods may 
be appropriate for drilling children in arithmetic ^ but in an activ- 
ity approach j longer clasi periods appear to be more desirable i since 
they would provide additional opportunities for extended discussions 
of mathematical toplce by children and teachers. 

ttony of the ratings on Objeetlvas 4 and 6 were incunclualve» as 
was predicted on the basis of the pilot study. If more observations 
had been possible, a substantially higher percentage of teachere might 
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have reeelved fflastery ratings on Objective 6, 

Teacher-student Interactinni Ob;i actives 7-10 . The four objec- 
tlvas dealing with teacher=student interaction were related to the 
teachers' use of student ideas, their tendency to criticize, and 
their questioning taehnlques. All four of these objectives were 
assessed by observation. 

The research on classroom interaction, suranarlzed by Flanders 
(1969). indicates that one characteristic of affective teachers is 
their use of student Ideas (Objective 7)~that Is. teachers who re= 
peat, modify, or sutnmarize student contributions seem to have classes 
that achieve more. Teachers in this study met the criterion level of 
802 for Objective 7. although multlunit school teachers tended to 
receive more mastery ratings than inner-city teachers (Table 22) . 

Objective 8, which deals with teacher criticism, is another be- 
havior that tends to be related to student achievement. Over 801 
of tha teachers achieved this 'objective, but again there were dif- 
ferences between multiunlt and inner-city schools, where a few teach= 
ers tended to be overly critical of student performance. One teach- 
er, for eKample, was heard berating a student during mathematics class, 
tailing him that what he had done was stupid. The differences in 
teacher criticism found in this study (Table 22) are consistent with 
the results of Goodlad, Klein, and Associates (1970. p. 92), who found 
less freedom and harsher discipline for children in inner-city class- 
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TABLE 22 

TEACHER ACHIEVEMENT OF OBJECTIVES 7 AND 8 



Muitiunlt 
Rating Number 


Teachers 
Percent 


Inner-c 
Number 


Ity Teachers 
Percent 


All. Teachers 
Number Percent 


Objeetive 7 


Mastary 19 


95.0 


12 


66.7 


31 


81.6 


Non-maitary 1 


5.0 


5 


27.8 


6 


15.8 


Inconclusive 0 


0,0 


1 


5.6 


1 


2.6 


Objective 8 


Mastery 20 


100.0 


13 


72,2 


33 


86,8 


Ndn-mastery 0 


0.0 


4 


22.2 


4 


10.3 


Inconclusive 0 


0.0 


1 


5.6 


1 


2.6 



roonis c 

AnDther aspect of claisroom interaction tm the teacher 'e queg=- 
tloning behavior* Objective 10 assessed whether the teacher used 
questioning and discussion techniques , rather than lecturing; al^ 
liinfif ii I I ItMirhru M did (Tiiltli* 1^1)^ llnwHvt^i , innjiy M*Hr|M*i'M (ihl iial 
follow their questions by asking students tu valltlAjto or justli:y 
their answer (Objective 9). Instead, the tendency for some teachers 
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TABLl 23 

TEACHER ACHlEVEmNT OF OBJECTIVES 9 AND 10 



Eating 




Oblectlve 9 


Oblectlve 10 


Nuniber 


Percant 


Nuniber 


Percent 


Mastery 


24 


63. 2 


35 


92.1 


Non—ma s t er y 


14 


36.8 


1 


2.6 


Inconclusiv* 


0 


0.0 


2 


5.3 



was to ask a question, declare the answer right or wrong, and ask 
another (or the same) question of a different student. A number of 
teachers appeared to be unwilling or unable to give up their role as 
the authority who tells children what Is mathematically correct or 
incorrect rather than helping children develop their own ability to 
validate mathematical statemenUa. Data on Objective 9 are Included 
In Table 23; the criterion level of 80% was not reached for this ob- 
jective. There was little difference between multlunlt and innar- 
clty teachers on this objective, nor were there differences between 
grade levels. 

Organization of the clas sroom. Oblectlves 11-15. An activity- 
approach elassroom has certain environmental characteristics i the 
children often work in small groups (Objective 11), the teacher is 
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a resource perion who moves from group to group (Objective 12)5 the 
children move about the room (Objective 13) and discuss thc^lr work 
with other students (Objective 14)5 and the classroom is arranged 
so that groups have a place to meat and work (Objective 15), Only 
two of the teachers failed to achieve all five" of these objectives, 
each of which was asseased by observation* 

While some of the teachers exprassed doubt that students in 
the primary grades could work together profitably in small groups , 
most of them did organize the students Into groups according to the 
recoimnendatlons for the activities (Objective 11). Some of the teach 
ers eicpressed considerable surprise at how well their students could 
cooperate and learn without the teacher being directly Involved, 
After ©rganlglng the children into groups , the teacher was expected 
to move from one group to another In order to ask and answer ques= 
tloni (Objective 12). The criterion level of 80% was eKceeded for 
both of these objectives (Table 24). , 

In an actlvlty-^approach classroom^ children should be allowed 
to move about the room to get the materials that they need for solv= 
ing the problems that are being worked on in the activity (Objective 
13) t Also, teachers were asked to allow children to discuss their 
work among themselvas (Objective 14), Teachers were rated as having 
achieved theee two objectives If their students did in fact move 
about the room and talk to each other. As indicated in Table 25 , 
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almost all teachers achiaved Objectives 13 and 14.- 

TABLE 24 

TEACHER ACHIEVEMENT OF OBJECTIVES 11 AND 12 



.Obleetlve 11 Objective 12 

Rating Number Percent Number Percent 



Mastery • 36 94.7 36 94.7 



Non-mastery 1 2.6 0 0.0 



Inconclusive 1 2,6 2 



TABLE 25 

TEACHER ACHIEVEMENT OF OBJECTIVES 13 AND 14 



Rating * 


Obleetlve 13 


Objective 14 


Number 


Percent 


Number 


Percent 


Mastery 


36 


94.7 


36 


94.7 


Non-mastery 


0, 


0.0 


1 


2.6 


lilcdncluslve 


2 


5.3 


1 


2.6 
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d active 15 dealt with another aspect of the classeoom envlron= 
ment, the arrangement of the furnishings and inaterlals in the class- 
room. For example, teachers were expected to provide areas where 
small groups could work when this was required for the activity. 
School buildings varied considerably in age and suitability for an 
activity approach, so the teacher was rated on how well she did with 
the room she had. Since a few classrooms were very small with desks 
nailed to the floor, there was little that could be done to make them 
into classrooms appropriate for an activity approach. But as Table 
26 indicates, most teachers achieved Objective 15. 

TABLE 26 ■ • 
TEACHER ACHIEVEiffiNT OF OBJECTIVE 15 



Rating 




Objective 15 




Number of 


Teachers 


Percent 


Itoatery 


36 




94.7 


Non-=mastery 


1 




2,6 


IncQncluslve 


1 




2.6 


Objective a 


11 through 15 


ware all achieved by 


over 90% of the 



teachers, exceeding the criterion level of 80%, However, achievement 
of these objectives represents only the minimum performance expected 
of teachers using an activity approach, and does not mean that the 
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classroom envlronmeTit waa glmllar for all teachers* On the contrary, 
the *'atinoephare" or "climate*' differed considerably from one class-- 
room to another. Some teachers^ for example, often encouraged stu^ 
dents to work . together on activities , while othetrs vmuld tolerate 
very little talk among the students. Assessing the citesroom environ^ 
ment in more detail is poseible, but it requires dlffei^ent instru= 
ments, different procedures p and more resources than were available 
for this study* 

Mathematical content of DMPi Oblectlves 16 and 17 . The teach^ 
ers in the study were expected as a minimum to be able to master the 
DMP student objectives (Objective 16) and to describe the mathemati- 
cal procesies emphasized in DOT (Objective 17), Since the study 
dealt with only klndargarten and firet-grade teachers ^ It Is not 
surprising that all of the teachers who were observed teaching toward 
DMP objectives received mastery ratinga on Objective 16 (see Table 
27), exceeding the criterion level of 901, Thlm objective will be- 
come more of a challenge to teachers of the geometry and probability 
and statistics strands of DM* at the upper elementary levels. 

Teachers were less successful at describing mathematical pro= 
cessas (Objective 17). They were asked In Questionnaire A to des- 
cribe three of the processes emphasized by DOT='-orderlng, equaliz- 
ings and validating* In the process of equalising ^ for example, 
the. child considers two objects that differ on some attribute such 
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as length or weight, and determinei how to make the two objects 

TABLE 27 

TEACHER ACHXEVEMENT OF OBJECTIVES 16 AND 17 





-_2M 


active 16 


Obiectlve 17 


Rating 


Number 


Percarit 


Number 


Percent 


Mastery 


35 


92.1 


22 


57.9 


Non-mastery 


0 


0.0 


15 


39.5 


Inconclusive 


3 


7.9 


1 


2.6 



equal on that attribute , either by adding on to the sraaller object dt 
taking away from the larger object. If the gtudent has two objects 
of measure a and b, the process of equalising allows him to solve 
the sentencea a + k ^ b and a ^ b^ To receive a mastery rating 
on Objective 17, the teacher had to describe all three processes 
correctly, and as Table 27 indicates , less than 60% of the teachers 
achieved this objective* Most of the teachers indicated that they 
had some Idea of what each process wflS , but their .responses were 
often very brief and inadequate. Thel criterion level of 80% was not 
reached for this objective. 

Managing instructioni Obj ectives 18-24. The objectives in this 
section deal with managing instruction in order to provide for Indi- 
vidual differencesi except for Objective 22, each of these objectives 
was measured primarily by questionnaire. Since the teachers In multl- 



105 



unit schools all had special background in the use of assessmtint 
materials in managing instruct ion, it was expected that they would 
excel on these objectives* Sometimes they did. 

In Objective 18, for example, teachers were expected to assess 
students and to keep records of student achievement* The multiunit 
teachers reached the criterion level of 80% on this objective, but 
the inner^city teachers^ did not (Table 28) , 

TABLE 28 . ■ 

TEACHER ACHIEVEMENT OF OBJECTIVES 18 AND 19 



Multiunit 
Rating Number 


Teachers 
Percent 


Inner-city Teachars 
Number Percent 


All 
Number 


Teachers 
Percent 


Objective 18 


tostery ^ 16 . 


80,0 


11 


61,1 


27 


71.1 


Non«=mastery 2 


10.0 


5 


27.8 


7 


18.4 


Inconclusive 2 


10.0 


■ 2 


11.1 


4 


10.5 




Objective 19 ' 








Mastery 17 


85.0 


8 


44.4 


25 


6S.8 ! 


Non^mastery 3 


15.0 


9 


50.0 


12 


31.6 


Inconclusive 0 


0.0 


1 


5.6 


1 


2.6 
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Data on Objective 18 were collected by both questlonnair'e and ■ 
liiterview, with the results of the Intarvlews largely confirming the 
questionnaire data. Of the 21 temchers Interviewed, 16 preaented the 
records of student achievement that they had reported on the question- 
naire. The other five teachers indicated changes In record-keeping 
. procedures during the four to eight weeks, between the time. of the 

interview and the questionnaire. One of these five teachers presented 
complated records at the Interview, although earlier in the question- 
naire she had reported that she did not keep records of student par- 
formance. The other four teachars reported on the questionnaire that 
they kept records, but did not have them available to show the inter- 
Viewer. Since there was disagreement hetwaen the questionnaire and 
the interviewer data for these five teachers, none of them was given 
a mastery rating. 

A number of different assessment instruments were provided for 
■the teachers, and they were asked to describe the purposes of these 
instruments (Objective 19). Again, the multlunlt teachers reached 
the criterion level of 80%, but the lnner=city teachers did not (Table 
28). 

Once teachars had assessed students, they were encouraged to use 
that information to form instructional groups whose mambers shared 
conmon needs (Objective 20). Many teachers did not follow this re- 
connnandation, but instead kept their students together in one in- 
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atructional group. As Table 29 indicates ^ the criterion level for 
Objective 20 was not met. However , there was one subgroup of teach= 
ers that did tend to group students by achievement; of the 14 first- 
grade teachers in multiunit schools, 12 of them (85.71) received 
maatery ratings on Objective 20, The reason for the higher ratlngB 
achieved by the first-grade, multiunit teachers is that inultiunit 
schools provide opportunities for planning time and flexible move^ 
ment of students from one teacher to another in order to facilitate 
the formation of Instructional groups with similar needs* Teachers 
in leif^contained classrooms generally did not have the same oppor- 
tuiiitlea, . , 

TABLE 29 

TEACHER ACHIEVEMENT OF OBJECTIVES 20 AND 21 









B 20 


Ob 1 active 


21 


Rating 


Number 




Percent 


Number 


Percent 


Mastery 


22 




57,9 


15 


39.5 


Non-mastery 


16 




42.1 


21 


55.3 


Inconclusive 


0 




0.0 


2 


5.3 



DOT instructional activities, like the assessment materials, are 
structured around mathematical objectives for the student. If a stu- 
dent has not mastered an objective, the teacher should be able to 
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choose an activity that is specifically designed to teach that objec- 
tive (Objective 21). According to data from the questionnaire, most 
teachers did not appear to use the code that related activities to 
objectives, and the criterion level of 80% for Objective 21 was not 
attained (Table 29), 

Classroom observers had noted that teachers in two multlunlt 
schools did seem to choose activities on the basis of the objectives, 
and the questionnaire data confirmed this. In these two schools, 
teachers assessed first-grade students on all the prerequisite be- 
haviors for first-grade materials, and then carefully chose activities 
that would help students improve their level of mastery of the objec- 
tives which they had not yet achieved. The process of choosing ac- 
tivities was supervised in each of these schools by particularly cap- 
able unit leaders, and nine out of the ten teachers in these two school 
received a mastery rating on Objective 21. In the other six schools, 
however, only six out of 28 teachers achieved this objective. While 
it was expected that non-multiunit school teachers would not do as 
well on Objective 21, it was surprising to find substantial differences 
within the set of four multiunit schools. One reason for the differ- 
ence in perfomiance between the multiunit school teachers appeared to 
be the competence and conscientiousness of the unit leaders. 

In providing for individual difference's, a coiranon problem for 
teachers is what to do with the child who finishes early. DMP materials 
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make sevaral recoimnendations about how tc re^dlrect these students 
(Objective 22) | sometimes independent work or additional activities 
were suggested for these atudents, and on other occasions pear tutor 
ing was recoOTnended as a way for the faster students to help their 
classmates. However, only seven of the teachers who were observed 
appeared to follow these recommendations for re-directing students, 
as Table 30 indicates* Rather, a common response from teachers to 
students who had finished early was to tell them to sit down and be 
quiet. The large number of inconclusive ratings for Objective 22 
resulted because often no students finished early during the time 
when the observer was present. 



TABLE 30 



TEACHER 


ACHIEVEMENT OF 


nnjECTivEs 


22 AND 23 




Racing 


Obi active 


22 


Ob-jectivi 


a 23 


Number Percent Number 


Percent 


Mastery 


7 


18.4 


21 


55.3 


Non-mastery 


4 


10.5 


17 


44.7 


Iticonclusive 


27 


71.1 


0 


0.0 



Another decision that teachers make in managing instruction 
deals with determining when a student has mastered prerequisite be- 
haviors well enough so that he can go on to a new topic. Teachers 
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were asked on a queatlonnalre to claisify hypothetical students on 
tha basis of assessment Information into two groups, those that were 
ready for a new topic and those that were not (Objective 23). Only 
55% of the teachers did this according to the procedures recommended 
In the assessment materials (Table 30). substantially less than the 
criterion level of 801. 

One feature of D^ff materials is that teachers are encouraged to 
choose from among a selection of activities in order to provide in- 
struction that meats the particular needs of their students. These 
choices involve alternate, optional, and review activities, as well 
as their sequencing. Teachers were assessed by questionnaire on 
their ability to identify the various options that were available to 
them (Objective 24). mtl^ the criterion level was not reached for 
all teachers in the study, 801 of the multiunit teachers did achieve 
this objective (Table 31). 

TABLE 31 

TEACHER ACHIEVEMENT OF OBJECTIVE 24 
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Multiunit 
Rating Number 


Teachers 
Percent 


Inner- 
Number 


city Teachers" 
Percent 


All 
Number 


Teachers 
Percent 


Mastery 16 


80.0 


6 


33.3 


22 


57.9 


Non-mastery 3 


15.0 


9 


50.0 


12 


31.6 


Inconclusive 1 


5.0 


3 


16.7 


4 


10.5 



Ill 



Summary of achievement; Ob.iectlvea 1-24 . The first queation 
to be answered by the study dealt with how well the teachers achieve 
each of, the objectives. Did the teachera reach the criterion levels 
of 90% for Objectives 1, 2, and 16, and 80% for each of the other 
obj actives? The results are sunmarized In Table 32, 

TABLE 32 
SUMIARY OF TEACHER PERFORMANCE 



Description 


Objective 


Criterion 


Level 






Attained Not 


attained 




1 


X 




Use of Dlff materials 


2 


X 






3 


X 




Structuring conmient^ 


4 




X 




5 


X 






6 




X 




7 


X 




Teacher -student Interaction 


8 


X 




9 




X 




10 


X 






11 


X 






12 


X 




Organization of the 


13 


X 




classroom 


14 


X 






15 


X 




Matheinatical content of 


16 


X 




Dlff 


17 




X 




18 




X 




19 




X 


Managing instruction 


20 




X 


21 




X 




22 




X 




23 




X 




24 




X 



The teachers reached the criterion level on 13 out of 24 objec- 
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tives. Of the 11 objectives for which the criterion level was not 
attained, seven dealt with managing instruction. Teachers In multi- 
unit schools, wish their extra background In assesament and Indi- 
vidualizing instruction, did reach the criterion level on three of 
the seven objectives related to managing instruction. Inner-city 
teachers, who had no apedlal background in providing for individual 
differences, did not reach the criterion level on any of the seven 
objeetlves involved in managing instruction. The implications of 
these results for evaluating the effectiveness of the inservice 
program are discussed in Chapter 7. 
Data on Question 2 

The second major question of this study concerned the propor- 
tion of teachers that would implement Dtff's activity approach in a 
minimally adequate way, where adequacy was defined for two groups of 
teachers. For multlunlt school teachers, adequate performance meant 
mastery of Objectives 1, 2, and 16, and mastery of five out of six 
of Objectives 3, 9=11, 17, and 20. For inner-city teachers, adequacy 
was defined In the same way, except for Objective 20; thay were ex- 
pected to master Objectives 1, 2, and 16, and four out of five of 
Objectives 3, 9-11, and 17. A teacher who satisfied the appropriate 
definition of adequate performance was called an implementing teach- 



er. 



Table 33 presents the data on Implementing and non-implementing 
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teachers in niultlunlt schools and In inner-city schools. Of the 38 
teachers in the study, 29 (761) ware classified as Implementing 
teachers. There was a slightly higher percentage of Implementing 
teachars in multiunit schools than In Inner-city schools -(Table 33), 
and in kindergarten as opposed to first-grade classrooms (Table 34). 
The differences, however , are not large. 

Of the nine nqn-iinplementing, teachers, two ware rather openly 
antagonistic toward the field test. They were both older, with many 
years of teaching experience, and both taught first grade in the 
same Itiner-clty school whose staff had not wanted to be Involved in 
the field test from the very beginning. They o.ten did not use BMP 
materials, and in fact preferred a more traditional approach. Another 
first-grade Inner-city teacher, who was absent frequently, had been 
observed only twice and therefore received only non-mastery or in- 
conclusive ratings on moat objectives; this teacher did not express 

TABLE 33 

MULTIUNIT AND INNER-CITY TEACHERS BY 
RATINGS ON IlffLEMNTING AN ACTIVITY APPROACH 





Multiunit 


Teachers 


Inner= 


city Teachers 


Total 


Category 


Number 


Percent 


Number 


Percent 


Number Percent 


Implementing 


16 


80,0 


13 


72.2 


29 76.3 


Non-implementing 4 


20*0 


S 


27.8 


9 23.7 
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TABLE 34 

KINDERGARTEN AOT FIRST-GRADE TEACHERS BY 
RATINGS ON IMPLEMENTING AN ACTIVITY APPROACH 



Kinderg 


arten 


First- 


-grade 


Total 


« ^ Number 
Category 


Percent 


Number 


Percent 


Number Percent 


Implementing 11 


84,6 


18 


72.0 


29 76.3 


Non-impleinentlng 2 


15,4 


7 


28*0 


9 23,7 



any resentment toward the program. As for the remaining ilx non-imple-^ 
menters, they aeemed to have no unifying characterlsties exeept for in- 
adequate performance on two of the important obj actives p usually Ob- 
jective 9 on aiking for validation of statements and Objective 17 on 
describing mathematical processes • These six teachers included one 
kindergarten teacher from each type of school ^ three first grade teach^ 
era from raultiunit schools , and one more first grade teachei^ from an 
lnner=city school, A more detailed discussion of the characteristics 
of non'-lmplementlng teachers is included in the next section. 
Data on Question 3 

The third question Investigated by this study Is the relation- 
ship between certain characteristics of teachers (like age, exper-^ 
lence, and professional activities) and their ability to change in 
order to adopt the behaviors that are involved in Implementing an 
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activity approach to learning mathematics. This section of the re-^ 
port will describe the important characteristics of the teachers 
who participated in the study and summarize tha results of the search 
for characteristics that were related to the teachers' ability to 
change - 

Teachers reported that they did have to change their practices 
in order to implement an activity approach. Of the 32 teachers who 
responded, 31 said that they had changed their teaching of mathe= 
matlcs since the previous year. When asked to describe the differ- 
ences between their present and previous teaching practices, 20 
mentioned some of the instructional aspects of an activity approach, 
such as use of manipulative materials and activities for small groups, 
and 12 referred to managing instruction using the assessment materials. 
Smaller numbers mentioned other factors, such as the Increased time 
spent on mathematics and the use of objectives. The changes reported 
by the teachers seem reasonable, since the previous year most of them 
had been using one of a number of commercially available mathematics 
programs* . • 

The teachers generally agreed that they had changed their teach- ' 
ing behavior in using DOT. But some of them, referred to earlier as 
Implementing teachers, were more succeosful than others in adopting 
the behaviors that make up DOT' s activity approach. Various charac= 
teristlcs of the teachers were investigated to determine if there 
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was any relationship between any of the characteristics and the 
teachers' ability to change and adopt an activity approach. 

Teacher attitude. While the teachers' attitude toward mache- 
matics ranged from highly unfavorable to highly favorable, they re- 
ported moderately positive attitudes toward the subject on the aver- 
age. While five teachers indicated that their attitude toward teach 
ing mathematics was more negative after using DMP, mostly because of 
the additional work and time that an activity approach takes, 21 re- 
ported a more positive attitude because they found DI^'s activity 
approach to be more stimulating and enjoyable. 

Implementing and non-implementing teachers showed only small 
differences in terms of attitude toward mathematics and teaching 
mathematics, with non-Implementing taachers reporting slightly more 
positive attitudes. Teachers who indicated a more negative attitude 
toward teaching mathematics after using Dtff were not more likely to 
be elasslfied as non-implementers . In general, teacher attitude did 
not appear to be an important factor In the teacher's ability to 
change and adopt an activity approach. 

Professional activities. One variable that many Investigators 
believe to be related to an individual's capacity for change is pro- 
fessional activity such as belonging to professional organizations, 
reading professional publications, and attending professional meet- 
ings. Most teachers in this study ware involved in these kinds of 
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professional activities. While one teacher reported no involvement 
In professional activities, others belonged to as many as five edu- 
cational organizations, read as many as seven educational journals 
regularly, and had attended up to five professional meetings in the 
past three yn^rs. None of these activities, however, was more char- 
acteristic of Implementing teachars than of non-lmplementlng teachers. 
Teachers were also classified by their achievement rating on each ob- 
jective and their involvement In each type of professional activity. 
Again, no substantial relationships were found. In addition to con- 
sidering the three kinds of professional activities separately, the 
frequencies of all three were combined to provide a single, more 
general Index of professional activity for the teachers In the study. 
The range of this general Index want from zero to fifteen, with a 
mean of approximately sIk. Again, there were no differences on this 
index between implementing and non-lmplementlng teachers, nor was 
there a relationship between teacher performance on Individual ob- 
jectives and teacher Involvement in professional activitlas. 

There are several possible explanations for this lack of a re- 
lationship between measures of professional activity and teacher per- 
formance on the objectives. First, the measures of professional ac- 
tivity were based on data reported by teachers, and it is difficult 
to determine, the reliability of self-report data. Second, the data 
on professional activity could havfe been Inadequate because they did 
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not measure the depth of the teachers' involvemeiit or the impact upon 
the teachers of their professional activity. Third, and perhaps most 
important, the teachers could find out all that they needed to know 
about an activity approach from the Inservlce program, and the power 
of the Inservice training could have overwhelmed any effect that pro- 
fessional activitias might have had on teacher performance. 

Age and exp erience . The only characteristics on which imple- 
menting and non-implementing teachers appeared to differ at all were 
age and years of teaching experience. The mean age of implementing 
teachers was approximately 41, while non-lmpiamentlng teachers' aver- 
age age was close to 46. in years of experience, Impleraentlng teach- 
ers average 12 years, compared to 19 for non-implementing teachers. 
Since the range of ages was more than 40 years and the years of ex- 
perience ranged from 1 to 34, these differences are not large rel- 
atively, but they appeared worthy of further investigation. 

In order to determine whether age and experience were impor- 
tant factors in teacher achievement of specific objectives, teachers 
were elassified by two attributes— age or experience as the first, 
and rating on an objective as the second attribute. This classifi- 
cation turned up only one objective where differences in achieve- 
ment appeared to be related to age or experienee; the objective 
dealt with teachers' competence in describing the mathematical pro- 
cesses emphasized by DMP CObJectlva 17). The results of this objec- 
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tlve, classified by age, are presented in Table 35 ■ replacing age 
by experience yields very similar results, as one would expect. 

TABLE 35 

TEACHERS CLASSIFIED BY AGE AND ACHIEVimqi OF OBJECTIVE 17 







Rating^ 






Age 


1 Mastery 


Non-mas t ery 


Inconclusive 


Total 


20-29 


5 


2 


0 


7 


30-39 


7 


4 


0 


11 


40-49 


6 


1 


0 


7 


50 and over 


3 


7 


1 


11 


No response 


1 


1 


0 


2 


Total 


22 


15 


1 


38 



While the data sunnnarized In Table 35 Indicate that older, more 
experienced teachers did not perform as well ais younger teachers on 
Objective 17 ^ this difference did not carry over to other objactiveg. 
Therefore p it appears that the relatively small differences in age 
and experience that existed between implementing and non-implement- 
ing teachers were not indicative of a more gener/il rc hitionHli Ip , 
and that the age-experience factor was not an important influence 
on the ability of teachers in this itudy to change and adopt an 
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activity approach* 

School charactertstlcs t The differences between teachers In 
multiunit and inner^city schools were discussed earlier in this 
chapter, and that discussion will not be repeated here. However^ 
there are two other characteristics of schools that have been sug- 
gested as important for changing teacher performance — the teachers* 
Involvement in decieion^nimking procedures and the principal -s sup-- 
port for the change. 

In, this study about half of the teachers reported that they 
were involved in the decision to participate in the DOT field test. 
In three schools the teachers played an active role in making the 
decision to participate | In two schools the teachers were not con^ 
suited at all* There was no consistent pattern In the other three 
schools I apparently some teachers were conaulted and others were not. 
In any casej the differences in daclsion^making procedures did not 
appear to be related to differences in teacher achievement of the 
various objectives* Non-implementing teachers had been involved in 
the decision to participate in the field test as often as imple- 
menting teacherSj and in the two multiunit schools where the teachers 
were not consulted at alls teacher performance was at least as good 
as in the other schopls. 

Most of the principals of the schools involved in this study 
fully supported the school's participation in the field test, accord- 
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Ing to the teachers. However, in two schools a majority of the 
teachers reported that their principal's support for D^ff was only 
moderate. Tha laek of support fron> these principals, one in 'a multi- 
unit school and one in an inner-city school, did not seem to affect 
teacher performance, in contrast to other studies (Chesler. Schmuck, 
& Llppltt, 1963) where the principal's support was believed to be 
crucial for Implementing change.- Not only was teacher performance 
unaffected, but also the teachers in the multlunlt school reported 
that they were trying to change the principal 's opinion of the value 
of their new approach to mathematics. 

The two characterlstlce of schools that have been discussed in 
this section-the teachers^ involvement in the decision to try a new 
mathematics program and the prlnclpars support for the changes-did 
not appear to be Important factors affecting teacher performance in 
the present study. This result is contrary to what one would expect 
after reviewing the literature on educational change (Havelock, 1969). 
Of course, the data in this study were gathered from only eight 
schools, too small a sample to provide a definitive result. In addi- 
tion, the extended period of Inservlce meetings could have reduced 
the effect of these school charanterlstlcs so much that they would 
not Influence teacher performance. 

Summary for question 3. This study found no characteristics 
that would differentiate between teachers who ars willing to change 
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and adopt new practices and teachers who are noti The iearch for 
these characteriitics was carried out by classifying the teachera 
on two varlablas™the first being performance on one of the 24 ob- 
jectives ^ and the other variable being one of the teacher Ghar-- 
acterlstics agsessed in the aturiy. The characteristics Included 
highest degree received, year the degree was received ^ years of 
teaching experience ^ &SSj professional activities , teacher attitude 
toward mathematics ^ teacher Involvement In decision makings 
teacher opinion of the principal -s support. An analysis of the 
claiilfled data indicated that there were no Important relationships 
between teacher performance on any objective and the teacher char" 
acterlstics I the use of formal correlational statistics was explored 
but deemed unnecessary due to the small number of teachers in the 
study* 

Characteristics of teachers and schools that other investigators 
believed to be important did not turn out to be so for the teachers 
In this study* Of course, the data reported here came from only a 
email sample of teachers and echoolSi and no definite conclusions 
can be drawn* 

Now that all of the data on teacher achievement has been pre= 
sentedi the next chapter indicates the conclusions Chat can be 
drawn from the data. 



Chapter 7 
CONCLUSIONS 

The data reported In Chapter 6 were organlEed around the ' 
three main questions Investigated by the study. This chapter Is 
organised In a similar manner, presenting first the conclusions 
regarding each of , the questions, and then discussing the Implications 
of Question 1 for the revision of the Inservice program, the 
limitatlong of the study. Its implications for mathematics education, 
and reconmendations for future research. 
The Ef fe etiveness of the Inservice Program 

The first question investigated by the study was the effective- 
nees of the Inservice program In helping teachers achieve each of the 
objectives related to implamantlng an activity approach to leamlng 
mathematics. The Inservice program was successful In helping teachers 
reach the criterion level for 13 of the 24 objectives (see Table 32 
In Chapter 6), These 24 objectives are listed in Appendix A in two 
main categories— providing instruction (Objectives 1=17) and managing 
instruction (Objectives 18-24). Objectlvee in the "providing 
Instruction" category deal with the Instructional materials used by 
the teacher, the teacher's verbal behavior, the classroom organization, 
and the teacher's knowledge of mathematics. The teachers In the study 
reached the crltarlon level on 13 of the 17 objectives related to 
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providing Inatruction. The other main catagory of objectives deals 
primarily with the teacher -s use of aasesement information In manag- 
ing instruction bo as to provide for Individual differences. The pro= 
portion of teachers who received mastery ratings on objectives related 
to managing Instruction generally ranged from 40% to 70%^ less than 
the criterion level of 80%* thus the Inservice program was not success 
ful in helping teachers reach ^ the criterion level for those objectives. 
However 5 It was expected that teachers from inner-^clty schools would 
have considerable difficulty mastering objectives related to managing 
initructlonj since the inner-city teachers had no special background 
in this area* The teachers In multiunlt schools^ on the other hand, 
did have special background in managing Instruction ^ and they were 
expected to have less difficulty achieving objectives related to that 
area. The data indicated that the expected differences did occur; 
multiunlt teachers reached the criterion level on three of the seven 
objectives related to managing Instruction^ while InTier^clty teachers 
never attained the criterion level on these seven objectives* In 
suiranary^ It appears that the inservice program was quite successful In 
helping teachers achieve the objectives related to providing Instruction 
through an activity approach^ but somewhat less successful In helping 
teachers manage an activity approach so as to provide individually 
guided Instruction in mathematics, particularly In non-mult lunit schools 
A more detailed dlacusslon of the reaaons that were related to the 
Inservice program not reaching the cflterlon levels for some objectives 
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±e included later in this chapter. 

The second major queatlon of this study involved the proportion 
of teachers that achieved a set of objectives that represented minimal 
ly adequate implementation of an activity approach to learning mathe- 
matics. According to this more global criterion, ag described in 
Chapter 4, 76X of the teachers in the study implemented an activity 
approach to learning mathematicB in at least a minimally adequate way. 
The Inservlce progrMi appeared to be about equally effective with all 
groups of teachers, aceordlng to this crlterloni for example, there 
were only email differences between grade levels, with kindergarten 
teachers doing somewhat better than first grade teachers, and even 
smaller differences between the two different kinds of schools, with 
multiunlt teachere being rated only slightly higher than inner-city 
teachers* 

The third queitlon Investigated by this study was the relationship 
of teacher characterlitics to the teachers' ability to change in order 
to implement an activity approach to learning mathematics. While the 
two teachers who refused to use the materials and disapproved of an 
activity approach were similar on many characterlitics — being older ^ 
eKperlenced first-grade teachers from the ame inner-city school— 
therQ were no teacher characteristics that were consistently related 



* More recent reports about these two teachers indicate that their 
performance changed considerably during the second semeiter, 
presumably due to the Influence of other teachers in their school. 



126 



to failure in Implementing an activity approach or to unsatisfactory 
ratings on the individual objectives for taaehers. The teacher 
charaetarlstlcs that were Investigated Included attitude toward mathe- 
matics and mathematics teaching. Involvement In professional activities, 
age, and years of teaching experience. None of these characteristics 
appeared to be related to the performance of teachers In this study. 
In addition, school characteristics, such as teacher Involvement in 
decision-making procadures and the principal's support for Implementing 
a new mathematics program, also appeared to be unrelated to teacher 
performance. Qna interpretation of this array of negative findlrigs is 
that, at least In the present study, the effect of these characteristics 
of teachers and schools was insignificant compared to the effect of the 
inservice program. In particular, the saries of Inservice meetings 
appeared to be Important In providing teachers with the support and 
encouragement that helped them to change their behavior and implement 
an activity approach to learning raatheinatlcs . 

The answers to the three main questions of the study indicate that 
the inservice program was ■ effective in most areas. The teachers reached 
the criterion level for most of the objectives (Question 1), and most 
teachers were successful In implementing an activity approach to learn- 
ing mathematics (Question 2). Also, the success of the InservleG 
program was not related to a particular set of teacher characteristics, 
but rather it seamed to be about equally effective for different kinds 
of teachere (Question 3). These results give some indication of the 
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adequacy of the design of the Inservice program used In the study. 
The Iniervice workshop generally presented the teachers with the 
Intormatlon that they needed to begin Implementing an activity approach, 
and the continuing leries of inservice meetings appeared to be a gooij 
means of helping the teachers as they changed their teaching practices. 

While the Inservice progrMi was successful in most areas ^ Ques- 
tion 1 of the study Identified a number of objectives where the criter- 
ion level wai not reached. The next section of the paper discusses 
each of , these objectivas, suggests reasons why they were not mastered 
more often, and where appropriate Indicates possible revisions in the 
inservice program. 

Implications of Question 1 for the Ingervlce Program 

The. data from Question 1 Indicate that teachera in the study were 
not successful In reaching the criterion level of 80% mastery on 11 of 
the 24 objectives. Four of these objectives were assessed by observa-- 
tlon. The most Important of these four objectives dealt with asking 
children to validate or justify their responses rather than to tell 
students that they were correct or Incorrect (Objective 9) ; this 
objective was achieved by only 63% of the teachers* Other research 
has also found that many mathematics teachers seldom use the type of 
probing questions related to Objective 9 (F^, 1969| Gall, 1970). 
Changing teachers' questioning techniques appears to be a difficult 
task which deserves extra attention during the inservice program. 
Three other behaviors that were often not demonstrated by 
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teachers were closing the activity with a discusiion (Objective 6), 
relating the activity to previous work (Objective 4), and re-^directing 
students who finished the activity before others (Objective 22)* No 
teacher received a non-mastery rating on Objective G; teachers did 
end the activities with a discussion of what the children had . 
aceompllahed J whenever possible. One difficulty appeared to be that 
mathemattee clasaes were often too short for the actlvltlei to ba 
brought to a logical conclus^n, and therefore many teachers received 
inconclusive ratings on Objective 6. Appropriate scheduling of school 
time would help teachers to achieve Objective 6 more regularly. Objec- 
tives 4 and 22 also were often not observable p but unlike Objective 65 
many teachers received non-maBtery ratings on these two objectives. 

Some changea In the conduct of the inservice program seem needed 
to Improve teacher performance on the four objectives described above 
(Objectives 4, 6, 9^ and 22)* While each of these objectives was 
discussed and demonstrated during both the Inservice workshop and 
inservice meetings 5 the teachers did not have an opportunity to practice 
exhibiting the desired behaviors themselves. Therefore 5 it is suggested 
that the inservice program could be strengthened by including an addi- 
tional two--hour workshop session or two more inservice meetings that 
would provide teachers with the opportunity to demonstrate each of 
these behaviors. One procedure for giving teachers a chance to practice 
these behaviors would be to have each teacher present one activity to 
a small group of teachers or children | during the preeenta*"ionj the 
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taacher should relmfce the activity to earlier lessons that children 
would have covered (Objective 4)^ ask probing questions (Objective 9), 
Indicate hew students who finished early could be re-dlrected (Objac- 
tlve 22), and close the activity by discussing what had been accomplished 
(Objective 6), This type of training would be similar in certain 
aspects to the mlcroteachlng techniques discussed in Chapter 2^ and 
should help teachers in^rove their performance on these objectives in 
the claisrooin. 

Objectives 4p 6, 9^ and 22 were the only objectives that were 
assessed by observation where the inservice program did not reach the 
criterion levels. The other instances when the criterion levels were , 
not attained included all seven objectives that were assessed primarily 
by questionnaire* One of the main reasons for poor performance on 
these objectives appeared to be that teachers spent very little time 
filling out the questionnaires i answers tended to be very brief and 
coniequently were often inadequate* Most teachers sHowed no concern 
about the possible evaluation of their responses; of course ^ the study 
was designed to promote this kind of non^evaluatlve atmosphere ^ which 
seemed in this case to result in relatively poor performance on the 
questionnaires* Thus it seems that the evaluator in etudies of this 
type is caught on the horns of a dilemiai if h© tella teachers they 
are being assessed , some of them are likely to report what they should 
have done, rather than what they did* if he does not tell them that 
they are being assessed ^ some teachers may perform lackadaisically on 
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the questionrialres rather than making a serious attempt to provide 
complete answers* While an effort was made to avoid either extremal 
the reauits from the present study Indicate that the second alter- 
native was probably related to poor performance by teachers on the 
questionnaire. 

Objective 17^ which dealt with the teachers' ability to describe 
the mathematical proeeBses ^mphasiged by DMP, was one of the objec- 
tives aeseeaed by questionnaire where the teachers did not do well* 
Approximately 40% of the teachers received non=mastery ratings on 
this objective J not because their responses were incorrect ^ but be- 
cause their responses were inadequate descriptions of the processes* 
Since the obiervers reported that meet teachers described the procesees 
adequately to their students^ it appears that at least some teachers 
could have done better if they had been willing^ to enend more tiine on 
the queetionnaire* Another factor that is likely to improve teacher 
perfofmance on Objective 17 is experience in working with DOT materials 
The teachere in the pilot study who were experienced in using the 
materials had no difficulty in describing the processes. 

Most teachers in multlunit schools kept records on student 
achievement (Objective 18) and correctly described the purpose of 
the various asseaamint Insttumeilts provided to teachers (Objective 19) . 
These assessment materials are a common part of multlunit school 
procedures. Teachers in non-multiunit schools, however , did not 
reach the 801 criterion level for these objectlves| 61% of the teachers 
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in eelf-contalneds inner^city claasrobms received mastery ratings on 
Objactlve I85 and 44% mastared Objective 19. Since teachers in nan- 
multlunit schools had had no previous experience in using these kinds 
of assassnient materials j their performance on Objectives 18 and 19 
repreeenta considerable improvement on their part , and an extra 
iniervice meeting dealing with these objectives would be likely to 
improve the teachers- performance even morfit 

Most teachers did not group students according to achievement 
(Objective 20). As indicated earlier^ this type of grouping is rath- 
er difficult to accomplish without the flexibility of the multlunit 
school organization* In addition^ many kindergarten teachers empha-^ 
size social development^ rather than academic achievement ^ and have 
no interest in grouping children on the basis of achievement. Thus 
the only teachers who consistently received mastery ratings on Objec^ 
tive 20 were first-grade teachers in multlunit schools. Some kinder'- 
garten and non-multiunlt teachers reported that they had found no 
need to group students on the basis of achievement; they claimed 
that 'they were better able to provide for individual differences in 
other ways* These teachers may very well be rights at least for 
kindergarten and flrit-grade children, and it may be unrealistic to 
expect them to achieve Objective 20, At higher grade levels ^ how- 
everp where student differences are greaterj grouping students by 
achievement is likely to be seen by more teachers as a useful proce* 
dure. 
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The remaining three objectlvea on which the teachers* performance 
wai Ibsb than satisfactory all dealt with managing instructlon—relatin 
objectlvei to activities (Objective 21)^ making declsiona about pre-^ 
requlsltei (Objedtlve 23) ^ and choosing an appropriate sequence of 
activities (Objective 24). Adequate performance on these three 
objectives requires only minimal knoi^ledge of how the materials for 
teachers are organized* The poor performance of all teachers ori 
Objectives 21 and 23 and of Inner-clty teachers on Objective 24 
appeared to result mainly from the fact that these objectives were 
covered during the workshop ^ but not emphasized again during the 
inservice meetings. Periodic reemphasis of these Ideas during the 
inservlce meetlngg should improve teacher performance on these 
objectlvea. 

In summary,, the Inservice program was successful in helping 
teachers achieve most of the objectives. The objectives which were 
not achieved by a substantial proportion of the teachers dealt with 
the verbal behavior of the teacher and managing Instruction in order 
to provide for individual differences. To improve teacher performance 
In these areas it was iuggested that two additions be made in the 
Inservice program^ including an extra two-hour session on the teachers' 
verbal behavior and art additional one-hour inservice meeting dealing 
with managing instruction. These changes in the inservice program 
should Improve the teachers' performance on objectives which were 
often not achieved without weakening the effectiveness of the Inservice 
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program in other areas* 

Limitations of the Study 
I Whenever a study ie carried out in a school settings there are 

always a large nxmhBX of extraneous variables that might have had an 

effect on the results of the study. For example, did an approaching 
snowstorm cause some teachers to do poor work in filling out their 
questionnaires because they wanted to leave early and get home before 
the storm hit? Did a threatened teacher strike have an effect on the 
way that some teachers and students performed in the classroom? These 
and other questions could be raised about possible confounding effeeta 
in this study* Not all of these effects will be discussed here; for 
a reasonably complete cataloguing of these kinds of extraneous varl-- 
ablesp see Campbell and Stanley (1963), This section of the chapter 
will discuss only those variables of particular importance in this 
study. 

One of the major limitations of the study is the selection 
variable — that is, the san^le of teachers included in the study may 
not be representative of any larger population. Rather ^ schools were 
selected for the field test In order to try out DOT materials with 
students from widely differing backgrounds and environments* Therefore » 
it is not possible to generalize the results of tlie study to any 
larger population of teachers* 

Another variable that may have been importanc in the study is the 
Hawthorne effect caused by the teachers* knowledge of participating in 
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the field test. While the teachers did not appear to be aware of the 
inservlce program reported In this paper, they were aware of che field . 
test procedurei for assessing student achievement and made their 
Interest evident* For example, when a random sample of students was 
selectad from a teacher's classroom. It was common for the teacher to 
tell the field test staff that the students selected Included too many 
"slow:er" Btudente to be really representative. The teachers apparently 
were concerned about their students' performance in the field test, 
and they are no doubt awaiting with Interest the published report of 
the field test which has been promised them* In future studies, 
teachers who are not Involved in a field test may not have this extra 
motivation to do wall in implementing an activity approach to learning 
mathematics. 

Another poBslble confounder in the study was the effect of the 
observers on teacher performance. In order to determine if the teach- 
eri performed differently in front of the observer than they did nor« 
roally, follow=up data were gathered from a random sample of 12 teachers 
on their feelings toward the observations. These teachers were asked 
if the presence of an obierver made teachers in their school uncomfor- 
table or caused them to teach dlf ferently . Three teachers thought 
that the observers made some teachers uncomfortable, and another said 
that teachers might be more careful about choosing the activity when 
an observer was present. All but one of the teachers, however , reported 
that the observers did not cause them any discomfort and that they did 
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not change their teaching when the obaerver was present* The results ' 
of theie brief interviews indicate that few 5 if any, teachers performed 
differently when the obaerver waa present, corroborating the opinion 
of the obaervars. However/ It is also possible that the periodic 
visits by the obeerveri could have had a positive effect on teacher 
parformance without making teachers feel that they were being evalua= 
ted. If further research indicates that the teachers' participation 
In the field test and the presence of observers in the classroom could 
each have been a factor in improving teacher performance, it may be 
advisable to Include these factors in every inservice program designed 
to help teachers implement an activity approach* These factors could 
be Included by letting teachers know that the materials being used ware 
being evaluated p and that part of the evaluation Included regular 
observations of student reactions to the materials* 

Since it was not possible to pretest teacher performance during 
the year before the field teat ^ there is no conclusive proof that 
the teachers- perforrimnce changed when they implemented an activity 
approach to learning mathematics. However ^ reports from teacherS|. 



leave little doubt that most of them did change their t^'0i^g practices 
conelderablyp These behavioral changes were np#i^lcularly noted by 
teaQhers when the change Involved DMR^i^iierlais, such as the assessment 
or manipulative materials* Chejiges in the verbal behavior of teachers 
arSj of course I more difficult to determine without pretest data, 

Willie it is clear that the teachers' performance did change, it is 
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not possible to dacide on the basis of the prasent study how much of 
that changa is attributable to the Inservice program and how much is 
due to the materials themeelves. Teachers certainly need materials 
like Dlff if they are to implement an activity approach to learning 
mathematlci, and experience in early tryouts of DMP indicates that 
teachers both want and need inservice training in order to implement 
an activity approach successfully. The present study has shown that 
most teachers in the field test ware able to perform adequately after 
they received inservice trainings but determining the precise effects 
of the various parts of the inservice program is a iubject for future 
research* 

Recommendations for Future Research 

The most direct follow'-up to the present study would be to 
Investigate the effectiveness of the various parts of the inservice 
program. Schools could be randomly assigned to varying treatments 5 
where s for example, Treatment 1 could be the complete inservice pro^ 
gram as described in this report j Treatment 2 the inservice workshop 
only, and Treatment 3 a brief introduction to DIff materials with no 
real inservice training at all. The same evaluation procedures could 
be used as in the present study—observations, questionnaires 5 and 
interviews. However , it would be very difficult for the observer to 
avoid holding Inservice' meetings for teachers in Treatments 2 and 3 
if the teachers believed him to have any competence in explaining the 
materials. Therefore, the observer would have to be clearly identified 
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for the teacheri as a perion who wanted to see DOT materials in 
action^ but who had no special knowledge of DOT, 

Planned comparisons mong the three treatinents would permit an 
aseeesment of the effectiveness of the Inservice workshop and the 
Inservice meetlnga. Careful analyais of the performance of teachers 
who received no substantial inservice training in Treatment 3 could 
also provide useful informtlon for school districts which could not 
afford the Inservice program* However^ extreme caution would be 
neceiiary in dealing with teachers in Treatment 3, for teachers find 
an activity approach so different from traditional mathematics programs 
that they feel a definite need for the iupport and guidance that comes 
through Inservice training* If denying inservice training to these 
teachers would cause them to become emotionally upset, humanitarian 
concern may make it necessary to change these teachers to a treatment 
group receiving some form of inservice training* Due to the possibility 
that teachers or students could be hurt by being involved in Treatment 
3, it would be advisable to try out such a treatment initially in a 
closely eontrolled laboratory situation. 

In order for an activity approach to learning mathematics to be 
widely and properly Implemented, it appears likely that inservice 
training will be necessary , and thus a large number of coordinators of 
inservice programs will need to be trained. The role of the coordinator 
would be mainly to conduct the inservice progrm for the teachers, to 
evaluate the teachers' success in implementing an activity approach to 
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learning mathematics * and to plan further staff development progrmns 
on the basli of that evaluation. Therefore, another research study 
is needed to Investigate what kind of training would be appropriate 
for inservlce coordinators. Such a research study is now being 
carried out by the staff of the mathematics project of the Wisconsin 
Research and Development Center. 

A third type of follow-up to the present study, and perhaps the 
most important kind of research 5 is to investigate the effect of teach^ 
er performance on^ student learning. The objectives for teachers in 
Appendix A are believed by the developers of the materials to be 
Important in helping teaehars maKimize student learning. The research ' 
cited in Appendix A supports this belief. To verify that these 
teacher behaviors are in fact related to student achievement will no 
doubt Invdlve a large number of studies over a long period of time* 
The first such study is now being conducted by a professor at Chicago 
State University, using data on teachers and students involved in the 
study reportftd in this paper. No results are yet available * 

Each of the three types of studies just mentioned would be a 
direct follow"-up to the present study. In additioni there are many 
other areas of resaarch In mathematics education that are related to 
helping teachers Implement an activity approach to learning mathematics. 
For example j what kinds of preservice training would be moat appropriate « * 
for elementary school mathematics teachers? Will more of an emphasis 
on the applications of mathematics , as reconmended' by the Conmittee on 
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the Undergraduate Program in Mathematici (1971) , help teachers Imple- 
ment an activity approach? Would it be advantageous to integrate the 
traditional content and methods courses for preservice teachers? 
These and other questions await the attention of researchers interested 
in finding ways to help teachers inplenient an activity approach to 
learning mathematics. 
Implications for Mathematics Education 

There is wide support in the mathematici education coimnunity for 
helping teachers Implement an activity approach to learning mathematics; 
also, it is widely acknowledged (Goodlad, Klein, & Associates, 1970) 
that most teachers are not using an activity approach and that changing 
the behavior of these taachers Is likely to be a very difficult task. 
The present study provides some Indication of procedures that are 
useful In helping teaehfirs improve their teaching practices. 

First, the study demonstrates the utility of specif ying teacher 
behaviors or teacher competencies in order to plan and evaluate inser- 
vice programs. The current trend toward stating teacher competencies 
in terms of behavioral objectives should have a good effect on the 
quality of the planning and evaluation of Inservice training in mathe- 
matics. This emphasis on teacher performance in the classroom does not 
mean that inservice programs should omit discussion of mathematics con- 
tent, but rather that teachers need help with more than just knowledge 
of mathematics if they are to change their teaching practices. 

. One way to provide both training in mathematics and an Indication 
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of new teaching methods to elementary school teachera la by having them 
become "active learners" themselves in a mathematics laboratory. Whlla 
the value of laboratory work for mathematics teachers is still under 
investigationi the teachers in the present study did profit from their 
opportunities to participate in laboratory-type settings. The teachers 
not only learned some new mathematics , but they also had a chance to 
make some discoveries on their owri and to see how they could provide 
similar oppor^tunities for their students. Thus It appears that com^ 
bining training in mathematics content and teaching methods in a 
laboratory setting should be an effective means of helping both inser-- 
vice and preiarvlce teacheri improve their performance in the mathe-' 
matics classrooTn, 

Another factor that appeared to be important in helping teachers 
change their behavior in the present study was the series of regular 
inservice meetings* In addition to the training that took place during 
these meetings, the teachers seemed to need the support that came from 
.knowing that others shared their problems and concerns ^ and that these 
concerns could be dlicuised openly without fear of any negative conse= 
quences. Such an atmosphere of cooperation and coranunicatlon is a 
worthy goal for any group of teachers ^ and mth the appropriate leader- 
ahlpi these kinds of group meetings could have an important effect on 
teacher performance* 

Judging from the response of the participants in this study ^ 
teachers are generally interested in and concerned about improving 
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their performance. They want to learn how to use new Ideas and new 
materials for teaching mathematics, particularly when they can see 
the effect of these changes on their students. But being open to 
change is not enoughi teachers need both Instruction and continued 
support as they change their performance. This portion of the thesis 
has Indicated several important procedures that could be used to 
Improve the teaching of mathematics In the elementary school, and If 
these procedures are widely Implemented and adapted for presarvlce as 
well as Inserviee teacher training programs, improvements In mathema- 
tics teaching will result. 
Summary 

The purpose of this study was to Investigate the ef f ectiyeness of 
an inserviee training program designed to help teachers implement an 
activity approach to learning mathematics. The Insarvlce program was 
successful in helping teachers achieve most of its objectives, and most 
teachers were able to Implement an activity approach In a minimally 
adequate way. Teacher performance did not appear to be. related to 
teacher characteristics such as age, experience, or professional 
activities. The study supports the view that a two- or three-day 
workshop at the beginning of the school year, followed by a series of 
four to six inserviee meetings during the first Half of the fall 
semester, is an effeetlve way to design an inserviee program For ele- 
mentary school mathematics teachers. The evaluation of the Inserviee 
program was carried out primarily through classroom observations, but 
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questionnaires and interviews were also used where appropriate. The 
study was conducted in conj unction with the field teat of Developing 
Mathematical Processes (DM') materials for kindergarten and first grade, 
thus following the recommendations of Gallagher, Nuthall, and Rosen- 
shine (1970) that classroom observation of teacher performance should 
be an integral part of currlculura evaluation. 

In contrast to most Inservice programs in mathematics , which have 
normally been remedial courses In mathematics content, the inservice 
program of this study emphasized the teaching strategies involved In 
an activity approach to learning mathematics. As Dublsch (1970) points 
out, the need for remedial Inservice training in mathematics Is now 
decreasing, and it Is more important to develop procedures designed 
to maintain teacher competence and to Increase professional growth. 
This study has provided part of the research base needed In the develop- 
ment and evaluation of one such set of procedures— specifically, the 
procedures Involved in an inservice program designed to help teachers 
implement an activity approach to learning mathematics. 
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OBJECTIVES FOR DMP TEACHERS 



The main purpose of eetabllihlng the following objectives for, DM^ 
teachera Is to provide a basis on which to evaluate the teachers' imple- 
mentation of the program. Asiesilng the teachers' achievement of these 
objectives will provide information on the effectiveness of the DKP in= 
service program and the usability of other DMP materials. A revised 
version of these objectives will be developed for future teachers of DM* 
to guide them ae they assesi their own effort to implement the program* 

The objectives for DOT teachers will be listed here in two main 
categories— providing instruction and managing tnstructinn. Providing 
Instruction will be subdivided into objectives dealing with the materials 
used by the teacher j the teacher's structuring comments (such as advanced 
organizers and post organlEars) , the Interaction between students and the 
teacher 5 the organization of the classroom, and the teacher's knowledge 
of the mathematical content of D^ff i Objectives related to managing instruc- 
tion deal primarily with the decisions that the teacher needs to make In 
order to provide individually guided education, and how the assessment 
Information is used in making these decisions. 

The statement of each objective will be accompanied by whatever extra 
explanation is required and by one or more ways to measure the achieve-- 
ment of that objective* When classroom observation Is used to measure 
achievement of an objective, the nimber of each related item of the 
Observation Schedule will be given. When the assessment is by queition- 
nalre, the number of the item in Questionnaire A will be given. The 
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Observation Schedule and Questionnaire A are included in Appendix B. 

PROVIDING INSTRUCTION 

The objectives for D^ff teachers specified in this section will deal 
primarily with the type uf instruction provided by the teacher. Some- 
times an objective will be subdivided into several parts, and these sub- 
criteria will be used to determine whether a teacher has demonstrated 
achievement of a particular objective, 
Use of dm Materials 

1, The teacher chooses activities (usually but not necessarily 
from the D^ff Teacher's Guide) that help students achieve the objectives 
of DOT. 

Assessment I Observation Schedule ^ 1,2, 1. 3, and 1.4 
If the teacher never used any of the activities from the DMP Teacher's 
Guide, or if the teacher chose to do activities that were in conflict with 
the objectives of D^, the teacher's performance on this objective would ' 
be considered unsatisfactory t .' 

2, The teacher provides the printed, manipulative, or other materials 
needed for the activity. 

Assessment r Observation Schedule - 11,1, 11,2, and 11,3 
The materials needed for each activity are specified in the DMF Teacher' 
Guide, The printed and manipulative matarials that are part of the DMP / 
Curriculum Package should be available for each teacher to use; it is ex- 
pected that other materials ^ such as scissors and graph paper, will be 
available from local iources. 
Structuring Commants 

3* The teacher identifies the problem or the objective of the ac^ 
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tivity^ providing an appropriate 

Aasesament^ Observation Schedule - 111,2 

4. During the opening or closing of an activity, the teacher etates 
the relationship of the activity to previous work. 

Assessment; Observation Schedule - III.l and III. 3 
Objectives 3 and 4 are to evaluate the teacher *s use of structuring 
comments that provide an overview of what is to come or a review of what 
has gone before. Providing this type of cognitive scaffolding seems to be 
particularly important when beginning or ending an activity (Roeenshlne 
and Furat, 1971, and Romberg and Wilson, 1972). 

5, During the opening (or closing) of an activity, the teacher qk- 
plains (or suimnarizes) the activity clearly and in a well=organlzed manner, 
presenting ideas at a cognitive level appropriate for the itudenta. 
Assessment: Observation Schedule ^ III. 4 

The clarity of the teacher's presentation Is an important variable in 
teaching, but difficult to meagure, involving as it does a high-inference 
judgement on the part of the observer (Rosenshine and Furst, 1971), To 
get independent information on this objective, a separata criterion will 
also be used. This criterion is item 111*5 of the Observation Schedule, 
which asks the observer to state the ratio of the number of students work^ 
ing profitably on the activity to the total number of students Involved, 
Of course, this ratio may also be affected by other factors, such as time 
of day, that are not related to the clarity of the presentation, 

6* During the closing of an activity, the teacher displays and dls-- 
cusses student work, while helping students work for cognitive closure. 



Assessment I Observation Schedule - III* 6 
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This objactive is very Important for some activities, such as whan 
students first begin to construct graphs. For other activltias. however, 
thera «ay ba no written work to ba discussed and this objectiva would not 
apply. 

Teacher-Student Infgractlon 

7. The teacher uses student lde„ by repeating them, modifying thr„, 
applying them, comparing them to other Ideas, or by summarising them. 
Assessment: Observation Schedule - V.l 

There is oonsldarable reaearch evidence that thia type of teacher be= 
havlor is related to student achievement and attitude (Flanders. 1969). 

8. The teacher does not criticise negatively a student's contribu-^ 
tions to a group discussion or to other group work. 
Assessment: Observation Schedule ~ V,3 

Nagative criticism tends to be correlated with lower student, achieve- 
ment (Rosanshlne and Furst, 1971. and Flanders, 1970). The Observation 
Schedule scores occurrences of negative criticism of student contributions, 
but not criticism of destructive or dangerous student behavior. 

9. The teacher responds to student statements by asking for vallda^ 
tion or Justification of the mathematical ideas expressed. 
Assessment: Observation Schedule - V. 2 and V. 4 

Questionnaire A - Items 8 and 9 
Several criteria will be used to assess this objective. First, ob- 
-rvere will note occasions whan the teacher asks students to validate or 
Justify a mathematical statement (7.2). Second, the observer will „ake a ' 
high-xnfersncs Judgement as to the teacher's usual behavior-is it that ' 
^ of a mathematical authority figure who normally tells students what is 
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tnathematically correct or incorrect (V.4), or is it Chat of a resource 
person who encourages students to justify their atatements? Thirds 
Items 8 and 9 of Questionnaire A ask the teacher how he would respond to 
a mathematical statement by a student i 

10, The teacher asks questions and leads discussions, rather than 
lecturing, 

Assesamenti Observation Schedule = V. 5 and V.6 

DOT activities are designed to be used in an inquiry--oriented class- 
room where the teacher ipends very little time lecturing. The two crif eria 
for this objective determine, first, whether the teacher asks queations 
or not (V,5), and second, whether the teacher relies primarily on question- 
ing methods or lecture methods (V,,6)r 

Organisation of the Classroom 

11, Given an activity that requires students to work individually, 
in pairs, in email groups, or in large groups , the teacher organises the 
students In the appropriate mode* 

Assessment: Observation Schedule - IV, 1 

The appropriate group siie depends on the requirements of the parti- 
cular activity being used. However, it is expected that the children will 
spend most of their time in individual and small group- activities , 

12. The teacher moves from group to group, or from individual to 
individual, acting as a resource person for the students. 
Assessment- Observation Schedule - IV* 2 

This rs an Important behavior because movini about the room gives the 
teacher the opportunity to assess the students, to ask probing questions 
that extend the child's understandini, and to provide extra help when this 
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Is needed. 

13. The teacher allows students to move purposefully about the 
room to obtain materials, to consult with others, or for other task- 
orianted reasons. 

Assessment! Obaervation Schedule - IV, 3 

14. The teacher allows students to Interact verbally while work- 
ing on the activity. 

Assessment I Observation Schedule - IV, 4 

15. The teacher arranges furnishings and materials in the room in 
a way that is recominended for the activity by the Teacher's Guide. 

Assessment; Observation Schedule - IV. 5 

In objectives 13, 14, and 15, the teacher is expected to provide a 
classroom environment that la conducive to an activity approach to learn- 
ing mathematics. Students, for example, should have access to mani- 
pulative materisls so that they can validate their assertions empirically, 
and developmental psychologists such as Lovell (1971) have often noted the 
desirable effects on learning of student-student interaction. Also, the 
classroom needs to be arranged so as to provide the facilities needed for 
the activity, such as areas where small groups can work together solving 
problems. 

Mathematical Content of Dt£P 

16. The teacher demonstrates mastery of the objectives being 
studied by his students. .. 

Assessments Classroom Observations \ 

17. The teacher describes the mathematical processes that are being 
used by his students. 



150 

Asgessments Questionnaire A - Item IS 

Classroom observations have shown that DMP teachers in kindergarten 
and flrit rrade do not have any difficulty in mastering the related atudent 
objectives. Teachers do have some difficulty ihowaver, in describing the 
processes that the students use and in. seeing where the processes lead. 
The teachers were asked to describe three of these processes in Question- 
naire A. 

MANAGING INSTRUCTION 
The objectives for DMP teachers specified in this section will deal 
primarily with the aiseisment component of DMPj and how the teacher uses 
assessment' Information In order to make decisions about managing instruct 
tlon* Since it la difficult to observe such decisions being made in the 
classroom^ these objectives will usually be tested through questionnaires. 

18, Using the appropriate aisessment InitrumentSj the teacher assesses 
students and completes the pupil performance records. 
Assessment! Questionnaire A - Items 1 and 5 

Observation Schedule - IV. 6 and iv\7 
Interviews with Teaehers 
The observer will note when the teaeher assesses a student during an 
activity (IV. 6) and when the teacher records that assessment (IV. 7). Also, 
Items 1 and 5 of Quistionnalre A ask the teacher for information on the 
use of the assessment Initruments and records. Additional Inforaation will 
be* gathered by the staff of the R and D Center as they Interview a random 
sample of teacheri on the usability of the assessment materials . ^ 

19. The teacher states the roles of the Placement Inventories and 
Topic Inventories. 
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Assegsments Questionnaire A ^ Item 7 

20. On the bails of Information gathered from PlaGemant Inventories 
and Topic Inventories^ the teacher forms instructional groups baaed on 
achievement. 

Assessment I Questionnaire A Items 2 and 6 

DMP aesesiment materiali help teachers to plaee children accurately 
in the Dtff sequence and to determine the children's achievement of each 
objactive. Using this information, the teacher can assign children with 
similar needs to the iama instructional group* 

21, t^en presented with a student who has not mastered an objective ^ 
the teacher can choose an activity that will help the student reach that 
objective. 

Assessment I QuestiDnnaire A Item 16 

Each activity is designed to help children reach one or more of the 
objectives of D>D?, and these objectives are identified as a part of the 
description of the activity. When given the objective, the teacher can 
find a related activity by reading the topic overview or the descriptions 
of the topic's activities, ^ 

22, The teacher re-directi individual students when they finish an 
activity, 

Asiessmenti Observation Schedule - IV#8 

This re-directing of students might involve beginning a new activity, 
peer tutoring on the activity jugt completed, or in some cases, working 
in an area other than mathematics* Re--directing need not involve formal 
assessment. 

23, When given the appropriate information on student achievement, 
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the teacher classifies students into two groups—those that have suf- 
ficient maitery of preraquisite behaviors to start a new topics and 
those that do not, 

Asaeasmentr Questionnaire A - Item 10 

"Dm aseessments use the ratings of Mastery (M) ^ Making Progress 
(P) , and Needs Considerable Help (N),in determining student achieve- 
ment of an objective, A student has sufficient maatery of prereq- 
uisite behaviors for a topic if he has no "N^* ratings. 

24, The teacher identifies the various options (including choice 
and sequence of activities) that are made available in each topic of the 
Teacher's Guide. 

Assessment I Queitlonnalre A Item 12 

The DOT Teacher's Guide gives the teacher a number of choices about 
which activities to do In each topic. Some activities are etrongly re- 
cpiranended; others are alternate or optional activities. In Questionnaire A, 
teachers are asked to identify reeoiranended sequences of ^ activltlaa for a 
topic; supplementary information on this objective will be obtained by 
noting the selection of activities used by teachers during classroom 
observations. 



Appendix B 

INSTRmffiNTS FOR GATHERING DATA 

The Observation Schedules DJff Inservlee-— Form 1 

DM* Questionnaires for Teachers : 

Questionnaire A 
Questionnaire B 
Questionnaire C 



153 



Dm INSERVICE--Form 1 



I» 1, School ; ■ Date 



2, Activity 
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1.2. 



1.3. 



Dtff INSERVICE— Form 1 
Observation Schedule 

I. General Information 

1.1. Identify the school, the observer (by initials), the teacher, 

and the date of the observation. 

Give the label of the activity observed ; If the activity is 
not taken from the Teacher's Guide, describe it briefly. If 
the teacher is in charge of students who are working on more 
than one activity, describe each of the activities. (Use la- 
bels, if possible.) 

Pind out from the teacher the activity done just previous to 
the one obierved* " 

I. 4. Find out from the teacher the activity that she plans to do 

next. If she has not dGclded which activity to do next, write 
"ND" and state any reasons that she may offer for not deciding 
until later. 

II. Materials 

II. 1. Identify the DIff pririted materials used. 

11. 2, Identify the manipulative materials used. 

11. 3. Identify other materials (e.g., crayons or graph paper) that 
are used in the activity and Important to the success of the 
activity when these materials have been provided by the teacher. 
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III. Structuring Comments — Opening and Closing Activities 

III.l. If the observation includes the Opening of the activity (or a 

part of an activity), mark 0| for the middle or closing of an 

activity, mark M or C, respectively. 
HI. 2. F. Focus— The teacher Identifies the problem and/or the 

objective of the activity (during the opening or the closing ^ 

usually) . Yes No ■ ■ 

111. 3. R. Relationship— The teacher states the relationship of this 
activity to previous work. Yea No 

111. 4. *G. Clarity—The teacher explains or suiranarlzes the activity 
clearly and in a well-organized manner, presenting ideas at 
a eognltlve level appropriate for her students. Yes No 

HI. 5. SW. Students Working— State the ratio of the number of students 
working profitably on the activity to the total numbar of 
atudents Involved. 0 - less than 25%, 1 - 25% up to SOX, 
2 - 50% up to 752, 3 - 75% or more. 

III. 6. D, Displays — The teacher displays and discusses student work 

at the close of the activity as she works for cognitive closure. 
Yes No 



* High-inference 
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IV. Structuring the Classroom 

IV, 1, G* Grouping—The teacher organlies tha studenti to work on 
the activity individually 3 In pairs, in small groups of 3 to 
10, or in large groupe of 11 or mora, (Mark 1, 2, 3, or 4, 
respactivelys ) 

IV. 2, TM. Teacher Movement—Tfte teacher moves from group to group 
(or individual to individual) ^ acting as a resource person 
for the s tudents * Yes No ^ 

IV. 3, SM, Student Movement— Students move purposefully about the 
room to obtain materials^ to consult with others, or for 
other task-oriented raaions. Ya§ Nc 

IV, 4, 1, Student=Student Intaractlon^ — Students Interact verbally 
while working on the activity. Yes No 

IV* 5. RO. Room Arrangemant^^The teacher arrangea furnishings and 
materials in the room in a way that is appropriate for the 
activity, (For example ^ this behavior is demonstrated when 
the teacher puts several desks together to form a work area 
for a small groups following suggestions from the description 
of. the activity.) Yes No 

IV. 6, s^A* Assessment — The teacher assesses a student on the objedtlves 
of the activity by observation , i.e., the teacher observes a 
student apparently for purposes of aiaessment^ whether or not 
the assesiment Is recorded. Yea No 

* High-inference 
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IV, 7. ^ Records Aasassment™The teacher records her observations 

of itudent achievement in the pupil performance records. 
Yes No . . ■ 

IV, 8. m. Re-Dlrects— The teacher redirects Individual students 

when they finish " an activity * Yes No 
^* Teacher=Studant Interaction 

Use of atudent ideas— the teacher usea student ideas by 
repeating them, modifying them, applying them, comparing them 
to other ideas ^ or by summarizing them, Ybb No 
^•2* Probing—The teacher probes a student regponse~i .e, , the 

teacher asks a student or a group of students to juslfy or 
clarify a statement or to validate a mathematical statement. 
Yes No 

Crlticlim— The teacher criticises a student ^s contribution 
to a group dlscusilon or to other group work,^ Yea No 
V.4. Authority— The teacher acts primarily as a mathematical 

authority figure rather than asking students to validate or 
justify their answers. Yes No 
^•5, Q. The teacher asks questions about mathematical Ideas re^ 

, lated to the activity. Yes Mo 
V,6. *L* The teacher uses lecture methods primarily rather than 

^ , inquiry techniques when discussing mathematical Ideas related 
to the activity. Yes No 



* High-inference 
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DMP QUESTIONNAIRES FOR TEACHERS* 

These questionnaires are designed to gathar information that 
will be uaad to Improve Dtff materials. Please feel free to expand 
upon your answers by writing in the margins or on the baek of these 
pages * 

Do not put your name on the questionnaire* Your responee will 
be handled in an anonymoua way 5 identified only by the code number. 
Thug you can feel completely free to be honest and direct in your 
anewera* 

There are often no "right" anawars to questions. All that is 
requested Is a frank itatement of your opinions and practices, along 
with some background information. 

The questionnaires are only one means of getting teachera* 
suggestions, and not every aspect of DMP is covered by these 
queationnaires. Considerable information has already been gathered 
from teachers J and more will be obtained later as R & D Center etaff 
continue to look for ideas on how to Improve BW^ 



* These questionnaires have been partially retyped to make ther 
more compact. 
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QUISTIONNAIRE A 

Thege questions deal mostly with Dm aasessment materials. 
These materials are still being revised and Improved, and your 
candid and critical comments will help with these revisions. 
1. Do you regularly fill out Pupil Performance Records such as 

a. Topic Checklists? 

b. Individual Progress Sheets? 
c*' Group Record Card? 

d. Other reGord-keeplng devices? (Please specify.) 

2. For each of the Pupil Performance Records that you fill out, 
indicate how you use the information on it, 
a. Topic Checklists ' 
Individual Progress Sheets 

c. Group Record Card 

d. Other record-keeping devices (Please specify.) 

3> If you did not fill out the Topic Checklists or Individual 
Progress Sheets, were there particular reasons why you found 
them to ba unworkable or did not choose to use them? ' 



\ 



Wliat Improvements do you suggeat in DOT record-keaplng pro 
cedures? 

Have you administered i 

a* Placement Inventory A? 

b. Placement Inventory B? 

c* Level 1 Topic Inventories? 

d* Level 2 Topic Inventories? 

a. Other asiesimenti? (Please specify.) 

In what waysp if^any, did you use the results of the aeeess 
ments that you administered? 

a. Placement Inventory 

b. Tople Inventories 

c» Other aasesamenti? (Pleaie specify*) 

Prom your point of view, state the purpoees of i 

a. Placement Inventories ' 

b. Topic Inventories 
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8* If a student shows you his work, and he has written 6 + 3 ^ 

how would you usually respond? (Check one or more responses, and 
add others if you wish*) 

a. I praise him even though his answer is incorrect* 

b. I ask him to change Iiis work to make it correct. 

^ I ask him to show how he found his answer* 

d . I tel.1 him that 6 + 3 = 9. 
Other (specify) 

9* If a student shows you his work^ and he has written 10 = 6 ^ 4 ^ how 
would you usually respond? (Check one or more responses ^ and add 
othera if you wish*) 

a * I praise him for getting the right answer, 

b * I ask ihim to show how he knowe his answer is correct* 

c, I tell him that 10 - 6 ^ 4 because 4 + 6 ^ 10, 

I aak him to tell other children what the right answer Is • 

e Other (specify) 
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Some of Che following questions deal with topics covered in 
the inservice workshops. Your responses will help us evaluate how 
clearly certain ideas were presented to you. in a lacer questionnaire 
you will be asked for suggestions on how to Improve the inservice 
program. 



Checklist 
Topic 17 


1 


Objectives 

2^ - 3 4 


Student k 
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P 
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- N 
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M 
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P 


P 
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Suppose that objectives 1, 3, and 4 are prerequisites for the next 
topic, and your Topic Checklist looks like the above. Which students 
are not ready to go on to the next topic? 



11. 

a. Have you had any difficulty in making decisions about when your 
own students were ready to go on to the next topic? 



b. If yes, what were the difficulties and how did you handle them? 
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Topic 
18 



Suggasted Sequence 

of Activitieg 

i 

for Topic 17 




Topic 
16 



.2 , On the baais of the sequance chart above, cheek any of thm following se^ 
quences of activities which arS choices that are reGommended in Topic 17 
1. 4, 6 

1. 2,3, 4,5,6 
1, 3* 4, 6 
1. 2, 3, 4, 5 
. 1, 2, 4, 6 
3. 4, 6 

If soma atudents needed more help, in which activities would one find 
additional suggesciona? 

• a. Do you find the sequence charts helpfui or not? 



b. How could they^be improved? 
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- • In describing the process of comparing to someone like a parent, 
you might include what students do or say or write when they use 
the process in solving a problem. For example', you might explain 
to a parant that students compare objects by telling whether they 
are alike or different in length or weight or some other way. If 
a student finds that one object is 6 units long and another is 8 
units long, he would write 6 8 to show the results of this 
coinparison, 

6 



6 ^ B 



Give a brief description (a sentence or two) of each of the following 
procasses as though you were explaining them to a parent. 



a, Orderini 



b, Equalliing 



c* Validating 



If a student needs to work on a certain objective in a DOT 
topic J how do you find activities in that topic that will 
help the sutdent reach the objective? 

a. Do you find that the Teacher's Guide is organized 
conveniently for choosing activities? 

b. How would you improve the organization of the Teacher's 
Guide? 



a. Do you find that the Assessment Manual is organized 
conveniently? 

b. How would you improve the organization of the Assessment 
Manual? 

Please state any other reactions or comments related to the 
Teacher's Guide or Assessment Manual that you may have. 
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QUESTIONNAIRE B 

The report of the DOT Field Test that you will receave will give 
a general description of the participating teachers and studenta. The 
purpose u Questionnaire B is to gather this general backgroimd infor- 
mation on teanhers. Of courae, this information will be reported only 
m terme of group data, auch as average. age^ not as Individual responBes. 
1. Please state the degrees you hold^ the year when each degree 
was received, and the institution that granted the degree. 
, Dg-gree . Year Institution 



2,^ Describe briefly any educational training that you have had in the 
past five years that is related to the topics listed below. Please 
.include -in your description the length of the training period and 
the name of the aponsoring Institution, 
a* Elementary Mathematics 

b. Elementary Science ^ 

c* Individualizing Instruction 

d. The "Open Claisrooni" or the British Infant Schools 

ERIC 

e. Team Teaching 
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3. Mow amny years of teaching experience do you havep including 
thie year? 

4. Please outline your teaching experience of the past five years. 

School System Grade Level Dates 

5. Have you been involved in the development and tryout of any 
other curriculum programs besides DOT? If yes, please give 
details - 

6* Aside from your teaching ^ what other educational eKperience 
(if any) hava you had in the past five years? 

7* What xs your age? 

20-24 25 - 21 30 34 35 = 39 

40 - 49 50 - 59 60 or over 



8* To what (If any) national ^ State , or local educational 
organlEations do you balong? 

9. miat prcfleeslonal educational publications (If any) do you 
read regularly? 

10, What (if any) professional maetlngs sponsored by educational 
organlEatiohs have you attended in the last three years? 
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QUESTIOtmAIRE C 



This questionnaire deals with opinions and attitudes about DOT 
and the inservice program. There are no right or wrong answers, so 
please be frank and honest in your replies * They will be of help in 
revising and improving DM*, Of courses your responses will be treated 
confidentially* 

1, As a student my general attitude toward mathematics was* 

Highly Moderately Mildly Mildly Moderately Highly 

Unfavorable^ Unfavorable Unfavorable Favorable Favorable Favorable 

2i My general attitude toward teaching mathematics prior *:o this year was ; 

Highly Moderately Mildly Mildly Moderately Highly 

Unfavorable Unfavorable Unfavorable^ Favorable^ Favorable Favorable 

3. As a teacher of DMP^ my general attitude toward teaching mathematics 1h: 

Highly Modarately Mildly Mildly Moderately Highly 

Unfavorable Unfavorable^ Unfavorable Favorable Favorable Favorable 

4* If your attitude toward teaching mathematics has changed, please eKplain 
what you believe caused the change* 



5. 



a* Did you teach mathematics last year? 

b. If yes, what program or text did you use? 
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a. Do you teach mathematics differently this year because of DKP? 

b. If yess please describe the differences* You may wish to refe] 
to objectives 5 assessment materials * manipulative materials, 
small group work, planning time, or other factors that are 
related to DMP, 

What do you like most about DOT? Why? 

What do you like least about DOT? Why? 

a* Overall^ do you like or dislike DOT? 

b. Is it better or worse than programs or texts you have usej in 
the past? 

c* In what ways? 
t 

a. If you attended a DOT summer workshop, was it useful or a waste 
of time? 

b. If it was useful, was It adequate or inadequate? 

c. How could it be Improved? 

Give your evaluation of the group meetings with Ron Langes Wayne 
Neuburgerj and (for Chicago teachera) Bernadette Perham, 
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12,* Give your evaluation of the individual conferences with Bernadatte 
Parham. 

13. 

a. Were you involved in making the decision to use DOT this year? 

b. If yes, how? 

c. If nOj explain how you think the decision was made. 



14. 

a. To what extant do you support the use of DW in your school? 

M oderately ^ Slightly N ot at all 



b. To what extent do you feel that your building principal supports 
the use of DJ^ In your school? 

Fully M oderately Slightly Not at all __ 

To what extent do you feel that the administration of your school 
system supports the use of DOT In your school? 

Fully M oderately ^Slightly J^ot at all 

d. What assistance have you received from your school system or from 
your principal that was particularly important in helping you use 

e* What assistance have you failed to receive that would have helped 
you in using DOT? 



* Chicago teachers only 



Appendices D, and E have been 
deleted from this publication^ but 
are available on microfilm at the 
University of Wisconsin Memorial Llbr 
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